vm-test-run-nixbot-gitlab
x86_64-linux.nixbot-gitlab
· build #123
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 13)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.JQhbxPlXjl', fmt=raw size=107374182412(finished: start all VMs, in 41.19 seconds)13gitlab # mke2fs 1.47.3 (8-Jul-2025)14gitlab: waiting for unit setup-gitlab.service15gitlab # Discarding device blocks: 0/262144 done16gitlab: waiting for the VM to finish booting17gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes18gitlab # Filesystem UUID: d6a6e71f-69b7-43a0-9694-85abb869ea2519gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... ok45gitlab # [ 0.000000] Linux version 6.18.34 (nixbld@localhost) (gcc (GCC) 15.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Jun 1 15:51:08 UTC 202646gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/q5drwqwazvjnw813clgrd23jd7lz3x47-nixos-system-gitlab-test/init regInfo=/nix/store/fngnr0i9yrwanqz6727yia6hp095agcd-closure-info/registration console=ttyS0,115200n8 console=tty047gitlab # [ 0.000000] BIOS-provided physical RAM map:48gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable49gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved51gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved55gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable56gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved57gitlab # [ 0.000000] NX (Execute Disable) protection: active58gitlab # [ 0.000000] APIC: Static calls initialized59gitlab # [ 0.000000] SMBIOS 2.8 present.60gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201461gitlab # [ 0.000000] DMI: Memory slots populated: 1/162gitlab # [ 0.000000] Hypervisor detected: KVM63gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000064gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0065gitlab # [ 0.000001] kvm-clock: using sched offset of 523952768 cycles66gitlab # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns67gitlab # [ 0.000006] tsc: Detected 2400.018 MHz processor68gitlab # [ 0.000818] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000069gitlab # [ 0.000855] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs70gitlab # [ 0.000858] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT71gitlab # [ 0.000910] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000072gitlab # [ 0.002788] found SMP MP-table at [mem 0x000f5470-0x000f547f]73gitlab # [ 0.002799] Using GB pages for direct mapping74gitlab # [ 0.002885] RAMDISK: [mem 0xbe4e0000-0xbffcffff]75gitlab # [ 0.002892] ACPI: Early table checksum verification disabled76gitlab # [ 0.002895] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )77gitlab # [ 0.002898] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002903] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002909] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)80gitlab # [ 0.002911] ACPI: FACS 0x00000000BFFE0000 00004081gitlab # [ 0.002913] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002915] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002916] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)84gitlab # [ 0.002917] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]85gitlab # [ 0.002918] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]86gitlab # [ 0.002919] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]87gitlab # [ 0.002920] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]88gitlab # [ 0.002920] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]89gitlab # [ 0.002921] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]90gitlab # [ 0.003422] No NUMA configuration found91gitlab # [ 0.003423] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]92gitlab # [ 0.003426] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]93gitlab # [ 0.005842] Zone ranges:94gitlab # [ 0.005843] DMA [mem 0x0000000000001000-0x0000000000ffffff]95gitlab # [ 0.005845] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]96gitlab # [ 0.005846] Normal [mem 0x0000000100000000-0x00000001bfffffff]97gitlab # [ 0.005847] Device empty98gitlab # [ 0.005848] Movable zone start for each node99gitlab # [ 0.005849] Early memory node ranges100gitlab # [ 0.005849] node 0: [mem 0x0000000000001000-0x000000000009efff]101gitlab # [ 0.005850] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]102gitlab # [ 0.005851] node 0: [mem 0x0000000100000000-0x00000001bfffffff]103gitlab # [ 0.005852] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]104gitlab # [ 0.005877] On node 0, zone DMA: 1 pages in unavailable ranges105gitlab # [ 0.006156] On node 0, zone DMA: 97 pages in unavailable ranges106gitlab # [ 0.117120] On node 0, zone Normal: 40 pages in unavailable ranges107gitlab # [ 0.118139] ACPI: PM-Timer IO Port: 0x608108gitlab # [ 0.118156] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])109gitlab # [ 0.118192] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23110gitlab # [ 0.118194] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)111gitlab # [ 0.118196] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)112gitlab # [ 0.118197] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)113gitlab # [ 0.118198] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)114gitlab # [ 0.118199] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)115gitlab # [ 0.118202] ACPI: Using ACPI (MADT) for SMP configuration information116gitlab # [ 0.118203] ACPI: HPET id: 0x8086a201 base: 0xfed00000117gitlab # [ 0.118209] TSC deadline timer available118gitlab # [ 0.118213] CPU topo: Max. logical packages: 1119gitlab # [ 0.118214] CPU topo: Max. logical dies: 1120gitlab # [ 0.118215] CPU topo: Max. dies per package: 1121gitlab # [ 0.118218] CPU topo: Max. threads per core: 1122gitlab # [ 0.118219] CPU topo: Num. cores per package: 4123gitlab # [ 0.118219] CPU topo: Num. threads per package: 4124gitlab # [ 0.118219] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs125gitlab # [ 0.118244] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()126gitlab # [ 0.118262] kvm-guest: KVM setup pv remote TLB flush127gitlab # [ 0.118266] kvm-guest: setup PV sched yield128gitlab # [ 0.118293] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]129gitlab # [ 0.118294] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]130gitlab # [ 0.118295] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]131gitlab # [ 0.118297] [mem 0xc0000000-0xfeffbfff] available for PCI devices132gitlab # [ 0.118298] Booting paravirtualized kernel on KVM133gitlab # [ 0.118302] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns134gitlab # [ 0.122765] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1135gitlab # [ 0.125026] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288136gitlab # [ 0.125078] kvm-guest: PV spinlocks enabled137gitlab # [ 0.125080] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)138gitlab # [ 0.125083] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/q5drwqwazvjnw813clgrd23jd7lz3x47-nixos-system-gitlab-test/init regInfo=/nix/store/fngnr0i9yrwanqz6727yia6hp095agcd-closure-info/registration console=ttyS0,115200n8 console=tty0139gitlab # [ 0.125177] Unknown kernel command line parameters "regInfo=/nix/store/fngnr0i9yrwanqz6727yia6hp095agcd-closure-info/registration", will be passed to user space.140gitlab # [ 0.125190] random: crng init done141gitlab # [ 0.125191] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes142gitlab # [ 0.134232] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)143gitlab # [ 0.138603] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)144gitlab # [ 0.138678] software IO TLB: area num 4.145gitlab # [ 0.213740] Fallback order for Node 0: 0146gitlab # [ 0.213748] Built 1 zonelists, mobility grouping on. Total pages: 1572726147gitlab # [ 0.213750] Policy zone: Normal148gitlab # [ 0.216302] mem auto-init: stack:all(zero), heap alloc:on, heap free:off149gitlab # [ 0.225592] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1150gitlab # [ 0.239240] allocated 12582912 bytes of page_ext151gitlab # [ 0.249464] ftrace: allocating 48565 entries in 192 pages152gitlab # [ 0.249466] ftrace: allocated 192 pages with 2 groups153gitlab # [ 0.250317] Dynamic Preempt: lazy154gitlab # [ 0.250496] rcu: Preemptible hierarchical RCU implementation.155gitlab # [ 0.250497] rcu: RCU event tracing is enabled.156gitlab # [ 0.250497] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.157gitlab # [ 0.250499] Trampoline variant of Tasks RCU enabled.158gitlab # [ 0.250500] Rude variant of Tasks RCU enabled.159gitlab # [ 0.250500] Tracing variant of Tasks RCU enabled.160gitlab # [ 0.250501] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.161gitlab # [ 0.250501] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4162gitlab # [ 0.250527] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.250529] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.250530] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.165gitlab # [ 0.254910] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16166gitlab # [ 0.255240] rcu: srcu_init: Setting srcu_struct sizes based on contention.167gitlab # [ 0.255359] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.262616] Console: colour VGA+ 80x25169gitlab # [ 0.262619] printk: legacy console [tty0] enabled170gitlab # [ 0.306412] printk: legacy console [ttyS0] enabled171gitlab # [ 0.505313] ACPI: Core revision 20250807172gitlab # [ 0.506864] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.512529] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.514814] x2apic enabled175gitlab # [ 0.516100] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.517839] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.520086] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.522858] kvm-guest: setup PV IPIs179gitlab # [ 0.525303] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.527145] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229848b50c4, max_idle_ns: 440795322125 ns181gitlab # [ 0.530221] Calibrating delay loop (skipped) preset value.. 4800.03 BogoMIPS (lpj=2400018)182gitlab # [ 0.532350] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.533360] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.534219] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.535223] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.537221] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.539220] Transient Scheduler Attacks: Mitigation: Clear CPU buffers188gitlab # [ 0.540219] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.541219] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.542219] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.544226] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier192gitlab # [ 0.545220] active return thunk: srso_alias_return_thunk193gitlab # [ 0.547248] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'194gitlab # [ 0.549219] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'195gitlab # [ 0.551219] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'196gitlab # [ 0.553219] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'197gitlab # [ 0.554219] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'198gitlab # [ 0.555219] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'199gitlab # [ 0.556219] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'200gitlab # [ 0.557219] x86/fpu: Supporting XSAVE feature 0x800: 'Control-flow User registers'201gitlab # [ 0.559219] x86/fpu: Supporting XSAVE feature 0x1000: 'Control-flow Kernel registers (KVM only)'202gitlab # [ 0.561220] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256203gitlab # [ 0.562219] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64204gitlab # [ 0.563219] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512205gitlab # [ 0.564219] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024206gitlab # [ 0.566219] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8207gitlab # [ 0.568219] x86/fpu: xstate_offset[11]: 2440, xstate_sizes[11]: 16208gitlab # [ 0.569219] x86/fpu: xstate_offset[12]: 2456, xstate_sizes[12]: 24209gitlab # [ 0.570219] x86/fpu: Enabled xstate features 0x1ae7, context size is 2480 bytes, using 'compacted' format.210gitlab # [ 0.599572] Freeing SMP alternatives memory: 44K211gitlab # [ 0.600221] pid_max: default: 32768 minimum: 301212gitlab # [ 0.602344] LSM: initializing lsm=capability,landlock,yama,bpf,ima213gitlab # [ 0.603307] landlock: Up and running.214gitlab # [ 0.604219] Yama: becoming mindful.215gitlab # [ 0.605429] LSM support for eBPF active216gitlab # [ 0.607425] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)217gitlab # [ 0.608367] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)218gitlab # [ 0.612311] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)219gitlab # [ 0.613808] Performance Events: Fam17h+ core perfctr, AMD PMU driver.220gitlab # [ 0.614230] ... version: 2221gitlab # [ 0.615221] ... bit width: 48222gitlab # [ 0.616221] ... generic counters: 6223gitlab # [ 0.617221] ... generic bitmap: 000000000000003f224gitlab # [ 0.618221] ... fixed-purpose counters: 0225gitlab # [ 0.619221] ... fixed-purpose bitmap: 0000000000000000226gitlab # [ 0.620221] ... value mask: 0000ffffffffffff227gitlab # [ 0.621221] ... max period: 00007fffffffffff228gitlab # [ 0.622221] ... global_ctrl mask: 000000000000003f229gitlab # [ 0.623343] signal: max sigframe size: 3376230gitlab # [ 0.624326] rcu: Hierarchical SRCU implementation.231gitlab # [ 0.625225] rcu: Max phase no-delay instances is 400.232gitlab # [ 0.626418] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level233gitlab # [ 0.631861] smp: Bringing up secondary CPUs ...234gitlab # [ 0.632631] smpboot: x86: Booting SMP configuration:235gitlab # [ 0.633224] .... node #0, CPUs: #1 #2 #3236gitlab # [ 0.637316] smp: Brought up 1 node, 4 CPUs237gitlab # [ 0.639221] smpboot: Total of 4 processors activated (19200.14 BogoMIPS)238gitlab # [ 0.640815] Memory: 6013344K/6290904K available (17098K kernel code, 2721K rwdata, 13520K rodata, 3644K init, 3008K bss, 258292K reserved, 0K cma-reserved)239gitlab # [ 0.643220] devtmpfs: initialized240gitlab # [ 0.644413] x86/mm: Memory block size: 128MB241gitlab # [ 0.648269] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns242gitlab # [ 0.649274] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)243gitlab # [ 0.650303] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).244gitlab # [ 0.651342] pinctrl core: initialized pinctrl subsystem245gitlab # [ 0.652616] PM: RTC time: 13:10:19, date: 2026-07-12246gitlab # [ 0.656141] NET: Registered PF_NETLINK/PF_ROUTE protocol family247gitlab # [ 0.658766] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations248gitlab # [ 0.659280] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations249gitlab # [ 0.661364] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations250gitlab # [ 0.662234] audit: initializing netlink subsys (disabled)251gitlab # [ 0.663458] audit: type=2000 audit(1783861819.528:1): state=initialized audit_enabled=0 res=1252gitlab # [ 0.663465] thermal_sys: Registered thermal governor 'fair_share'253gitlab # [ 0.665221] thermal_sys: Registered thermal governor 'bang_bang'254gitlab # [ 0.666221] thermal_sys: Registered thermal governor 'step_wise'255gitlab # [ 0.667222] thermal_sys: Registered thermal governor 'user_space'256gitlab # [ 0.668221] thermal_sys: Registered thermal governor 'power_allocator'257gitlab # [ 0.669257] cpuidle: using governor menu258gitlab # [ 0.672458] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5259gitlab # [ 0.673546] PCI: Using configuration type 1 for base access260gitlab # [ 0.674221] PCI: Using configuration type 1 for extended access261gitlab # [ 0.675417] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.262gitlab # [ 0.678363] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages263gitlab # [ 0.679222] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page264gitlab # [ 0.680221] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages265gitlab # [ 0.681221] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page266gitlab # [ 0.686592] ACPI: Added _OSI(Module Device)267gitlab # [ 0.689229] ACPI: Added _OSI(Processor Device)268gitlab # [ 0.693231] ACPI: Added _OSI(Processor Aggregator Device)269gitlab # [ 0.702118] ACPI: 1 ACPI AML tables successfully acquired and loaded270gitlab # [ 0.712839] ACPI: Interpreter enabled271gitlab # [ 0.715502] ACPI: PM: (supports S0 S3 S4 S5)272gitlab # [ 0.719234] ACPI: Using IOAPIC for interrupt routing273gitlab # [ 0.723516] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug274gitlab # [ 0.730231] PCI: Using E820 reservations for host bridge windows275gitlab # [ 0.734936] ACPI: Enabled 2 GPEs in block 00 to 0F276gitlab # [ 0.751666] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])277gitlab # [ 0.755238] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]278gitlab # [ 0.761509] acpiphp: Slot [3] registered279gitlab # [ 0.764306] acpiphp: Slot [4] registered280gitlab # [ 0.766306] acpiphp: Slot [5] registered281gitlab # [ 0.769349] acpiphp: Slot [6] registered282gitlab # [ 0.771304] acpiphp: Slot [7] registered283gitlab # [ 0.773263] acpiphp: Slot [8] registered284gitlab # [ 0.774264] acpiphp: Slot [9] registered285gitlab # [ 0.776288] acpiphp: Slot [10] registered286gitlab # [ 0.777265] acpiphp: Slot [11] registered287gitlab # [ 0.778496] acpiphp: Slot [12] registered288gitlab # [ 0.780265] acpiphp: Slot [13] registered289gitlab # [ 0.782315] acpiphp: Slot [14] registered290gitlab # [ 0.785341] acpiphp: Slot [15] registered291gitlab # [ 0.788313] acpiphp: Slot [16] registered292gitlab # [ 0.791325] acpiphp: Slot [17] registered293gitlab # [ 0.794312] acpiphp: Slot [18] registered294gitlab # [ 0.798350] acpiphp: Slot [19] registered295gitlab # [ 0.801312] acpiphp: Slot [20] registered296gitlab # [ 0.804310] acpiphp: Slot [21] registered297gitlab # [ 0.807326] acpiphp: Slot [22] registered298gitlab # [ 0.810347] acpiphp: Slot [23] registered299gitlab # [ 0.813313] acpiphp: Slot [24] registered300gitlab # [ 0.817311] acpiphp: Slot [25] registered301gitlab # [ 0.820311] acpiphp: Slot [26] registered302gitlab # [ 0.823321] acpiphp: Slot [27] registered303gitlab # [ 0.825367] acpiphp: Slot [28] registered304gitlab # [ 0.828296] acpiphp: Slot [29] registered305gitlab # [ 0.830325] acpiphp: Slot [30] registered306gitlab # [ 0.833295] acpiphp: Slot [31] registered307gitlab # [ 0.835430] PCI host bridge to bus 0000:00308gitlab # [ 0.838269] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]309gitlab # [ 0.841229] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]310gitlab # [ 0.843222] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]311gitlab # [ 0.845296] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]312gitlab # [ 0.850234] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]313gitlab # [ 0.856232] pci_bus 0000:00: root bus resource [bus 00-ff]314gitlab # [ 0.861388] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint315gitlab # [ 0.869546] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint316gitlab # [ 0.877521] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint317gitlab # [ 0.889415] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]318gitlab # [ 0.893390] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk319gitlab # [ 0.898228] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk320gitlab # [ 0.902226] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk321gitlab # [ 0.905227] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk322gitlab # [ 0.909853] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint323gitlab # [ 0.916318] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]324gitlab # [ 0.919804] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint325gitlab # [ 0.922844] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI326gitlab # [ 0.925237] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB327gitlab # [ 0.927920] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint328gitlab # [ 0.938334] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]329gitlab # [ 0.940248] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]330gitlab # [ 0.942273] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]331gitlab # [ 0.944481] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]332gitlab # [ 0.959228] pci 0000:00:02.0: pci_fixup_video+0x0/0x100 took 14648 usecs333gitlab # [ 0.962456] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint334gitlab # [ 0.968254] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]335gitlab # [ 0.969236] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]336gitlab # [ 0.971273] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]337gitlab # [ 0.973268] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]338gitlab # [ 0.978447] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint339gitlab # [ 0.985263] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]340gitlab # [ 0.989265] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]341gitlab # [ 0.993359] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]342gitlab # [ 1.005963] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint343gitlab # [ 1.020266] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]344gitlab # [ 1.024256] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]345gitlab # [ 1.027331] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]346gitlab # [ 1.036654] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint347gitlab # [ 1.045323] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]348gitlab # [ 1.049286] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]349gitlab # [ 1.054359] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]350gitlab # [ 1.066808] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint351gitlab # [ 1.086267] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]352gitlab # [ 1.090266] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]353gitlab # [ 1.095360] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]354gitlab # [ 1.104227] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint355gitlab # [ 1.115280] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]356gitlab # [ 1.119268] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]357gitlab # [ 1.124359] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]358gitlab # [ 1.135625] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint359gitlab # [ 1.148265] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]360gitlab # [ 1.152266] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]361gitlab # [ 1.157386] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]362gitlab # [ 1.162265] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]363gitlab # [ 1.171354] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint364gitlab # [ 1.180280] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]365gitlab # [ 1.184315] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]366gitlab # [ 1.192844] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint367gitlab # [ 1.206265] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]368gitlab # [ 1.210264] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]369gitlab # [ 1.215373] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]370gitlab # [ 1.226553] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint371gitlab # [ 1.238255] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]372gitlab # [ 1.241255] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]373gitlab # [ 1.245338] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]374gitlab # [ 1.264818] ACPI: PCI: Interrupt link LNKA configured for IRQ 10375gitlab # [ 1.268649] ACPI: PCI: Interrupt link LNKB configured for IRQ 10376gitlab # [ 1.272632] ACPI: PCI: Interrupt link LNKC configured for IRQ 11377gitlab # [ 1.276642] ACPI: PCI: Interrupt link LNKD configured for IRQ 11378gitlab # [ 1.280446] ACPI: PCI: Interrupt link LNKS configured for IRQ 9379gitlab # [ 1.287381] iommu: Default domain type: Translated380gitlab # [ 1.290231] iommu: DMA domain TLB invalidation policy: lazy mode381gitlab # [ 1.294686] ACPI: bus type USB registered382gitlab # [ 1.295397] usbcore: registered new interface driver usbfs383gitlab # [ 1.297258] usbcore: registered new interface driver hub384gitlab # [ 1.301334] usbcore: registered new device driver usb385gitlab # [ 1.309017] NetLabel: Initializing386gitlab # [ 1.312230] NetLabel: domain hash size = 128387gitlab # [ 1.316230] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO388gitlab # [ 1.320510] NetLabel: unlabeled traffic allowed by default389gitlab # [ 1.325269] PCI: Using ACPI for IRQ routing390gitlab # [ 1.330510] pci 0000:00:02.0: vgaarb: setting as boot VGA device391gitlab # [ 1.331216] pci 0000:00:02.0: vgaarb: bridge control possible392gitlab # [ 1.331216] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none393gitlab # [ 1.346249] vgaarb: loaded394gitlab # [ 1.349851] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0395gitlab # [ 1.352225] hpet0: 3 comparators, 64-bit 100.000000 MHz counter396gitlab # [ 1.360637] clocksource: Switched to clocksource kvm-clock397gitlab # [ 1.369551] VFS: Disk quotas dquot_6.6.0398gitlab # [ 1.373082] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)399gitlab # [ 1.379526] pnp: PnP ACPI init400gitlab # [ 1.384286] pnp: PnP ACPI: found 6 devices401gitlab # [ 1.400883] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns402gitlab # [ 1.407331] clocksource: Switched to clocksource acpi_pm403gitlab # [ 1.411761] NET: Registered PF_INET protocol family404gitlab # [ 1.418703] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)405gitlab # [ 1.451503] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)406gitlab # [ 1.454061] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)407gitlab # [ 1.456428] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)408gitlab # [ 1.461128] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)409gitlab # [ 1.463413] TCP: Hash tables configured (established 65536 bind 65536)410gitlab # [ 1.465664] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)411gitlab # [ 1.468279] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)412gitlab # [ 1.470554] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)413gitlab # [ 1.472808] NET: Registered PF_UNIX/PF_LOCAL protocol family414gitlab # [ 1.474591] NET: Registered PF_XDP protocol family415gitlab # [ 1.476112] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]416gitlab # [ 1.477944] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]417gitlab # [ 1.479812] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]418gitlab # [ 1.481855] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]419gitlab # [ 1.483890] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]420gitlab # [ 1.486216] pci 0000:00:01.0: PIIX3: Enabling Passive Release421gitlab # [ 1.488019] pci 0000:00:00.0: Limiting direct PCI/PCI transfers422gitlab # [ 1.494492] ACPI: \_SB_.LNKD: Enabled at IRQ 11423gitlab # [ 1.502766] pci 0000:00:01.2: quirk_usb_early_handoff+0x0/0x7c0 took 12223 usecs424gitlab # [ 1.508875] PCI: CLS 0 bytes, default 64425gitlab # [ 1.512344] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)426gitlab # [ 1.512826] Trying to unpack rootfs image as initramfs...427gitlab # [ 1.513238] software IO TLB: mapped [mem 0x00000000ba4e0000-0x00000000be4e0000] (64MB)428gitlab # [ 1.513553] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229848b50c4, max_idle_ns: 440795322125 ns429gitlab # [ 1.562068] Initialise system trusted keyrings430gitlab # [ 1.564019] workingset: timestamp_bits=40 max_order=21 bucket_order=0431gitlab # [ 1.577348] Key type asymmetric registered432gitlab # [ 1.578696] Asymmetric key parser 'x509' registered433gitlab # [ 1.580307] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)434gitlab # [ 1.582958] io scheduler mq-deadline registered435gitlab # [ 1.584436] io scheduler kyber registered436gitlab # [ 1.589368] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled437gitlab # [ 1.591678] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A438gitlab # [ 1.595829] Linux agpgart interface v0.103439gitlab # [ 1.597227] ACPI: bus type drm_connector registered440gitlab # [ 1.601644] usbcore: registered new interface driver usbserial_generic441gitlab # [ 1.603572] usbserial: USB Serial support registered for generic442gitlab # [ 1.605376] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.443gitlab # [ 1.605376] Please enable it if your BIOS has the CPPC option.444gitlab # [ 1.609344] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled445gitlab # [ 1.611718] drop_monitor: Initializing network drop monitor service446gitlab # [ 1.613740] NET: Registered PF_INET6 protocol family447gitlab # [ 1.616677] Segment Routing with IPv6448gitlab # [ 1.618166] In-situ OAM (IOAM) with IPv6449gitlab # [ 1.624421] IPI shorthand broadcast: enabled450gitlab # [ 1.638353] sched_clock: Marking stable (1373074364, 264968177)->(1716924603, -78882062)451gitlab # [ 1.646224] registered taskstats version 1452gitlab # [ 1.650340] Loading compiled-in X.509 certificates453gitlab # [ 1.673767] Demotion targets for Node 0: null454gitlab # [ 1.675670] Key type .fscrypt registered455gitlab # [ 1.676924] Key type fscrypt-provisioning registered456gitlab # [ 1.678685] ima: No TPM chip found, activating TPM-bypass!457gitlab # [ 1.680387] ima: Allocated hash algorithm: sha1458gitlab # [ 1.681911] ima: No architecture policies found459gitlab # [ 1.683844] PM: Magic number: 2:901:179460gitlab # [ 1.685225] acpi device:0f: hash matches461gitlab # [ 1.687567] RAS: Correctable Errors collector initialized.462gitlab # [ 1.693044] clk: Disabling unused clocks463gitlab # [ 1.694322] PM: genpd: Disabling unused power domains464gitlab # [ 1.795909] Freeing initrd memory: 27584K465gitlab # [ 1.804878] Freeing unused decrypted memory: 2028K466gitlab # [ 1.814232] Freeing unused kernel image (initmem) memory: 3644K467gitlab # [ 1.819428] Write protecting the kernel read-only data: 32768k468gitlab # [ 1.827405] Freeing unused kernel image (text/rodata gap) memory: 1332K469gitlab # [ 1.833866] Freeing unused kernel image (rodata/data gap) memory: 816K470gitlab # [ 1.898018] x86/mm: Checked W+X mappings: passed, no W+X pages found.471gitlab # [ 1.900116] Run /init as init process472gitlab # [ 1.915347] systemd[1]: Inserted module 'autofs4'473gitlab # [ 1.943947] fuse: init (API version 7.45)474gitlab # [ 1.966329] ACPI: \_SB_.LNKC: Enabled at IRQ 10475gitlab # [ 1.976817] ACPI: \_SB_.LNKA: Enabled at IRQ 10476gitlab # [ 1.982287] ACPI: \_SB_.LNKB: Enabled at IRQ 11477gitlab # [ 2.034668] systemd[1]: Successfully made /usr/ read-only.478gitlab # [ 2.375173] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)479gitlab # [ 2.396608] systemd[1]: Detected virtualization kvm.480gitlab # [ 2.400536] systemd[1]: Detected architecture x86-64.481gitlab # [ 2.404506] systemd[1]: Running in initrd.482gitlab # [ 2.408935] systemd[1]: Initializing machine ID from random generator.483gitlab # [ 2.414178] systemd[1]: Hostname set to <gitlab>.484gitlab # [ 2.488143] systemd[1]: Queued start job for default target Initrd Default Target.485gitlab # [ 2.660145] systemd[1]: Created slice Slice /system/modprobe.486gitlab # [ 2.662305] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.487gitlab # [ 2.667741] systemd[1]: Expecting device /dev/disk/by-label/nix-store...488gitlab # [ 2.672836] systemd[1]: Expecting device /dev/disk/by-label/nixos...489gitlab # [ 2.677811] systemd[1]: Reached target Path Units.490gitlab # [ 2.681764] systemd[1]: Reached target Slice Units.491gitlab # [ 2.685788] systemd[1]: Reached target Swaps.492gitlab # [ 2.688894] systemd[1]: Reached target Timer Units.493gitlab # [ 2.692461] systemd[1]: Listening on D-Bus System Message Bus Socket.494gitlab # [ 2.696807] systemd[1]: Listening on Journal Socket (/dev/log).495gitlab # [ 2.700892] systemd[1]: Listening on Journal Sockets.496gitlab # [ 2.704114] systemd[1]: Listening on udev Control Socket.497gitlab # [ 2.705949] systemd[1]: Listening on udev Kernel Socket.498gitlab # [ 2.707679] systemd[1]: Reached target Socket Units.499gitlab # [ 2.714038] systemd[1]: Starting Create List of Static Device Nodes...500gitlab # [ 2.720370] systemd[1]: Starting Load Kernel Module 9pnet_virtio...501gitlab # [ 2.732606] systemd[1]: Starting Load Kernel Module configfs...502gitlab # [ 2.738028] systemd[1]: Starting Journal Service...503gitlab # [ 2.743836] systemd[1]: Starting Load Kernel Modules...504gitlab # [ 2.745582] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki505gitlab # [ 2.752083] systemd[1]: Starting Coldplug All udev Devices...506gitlab # [ 2.764089] systemd[1]: Finished Create List of Static Device Nodes.507gitlab # [ 2.767433] systemd[1]: modprobe@configfs.service: Deactivated successfully.508gitlab # [ 2.772046] systemd[1]: Finished Load Kernel Module configfs.509gitlab # [ 2.778552] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config510gitlab # [ 2.785895] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...511gitlab # [ 2.794194] netfs: FS-Cache loaded512gitlab # [ 2.798729] systemd-journald[150]: Collecting audit messages is disabled.513gitlab # [ 2.805035] 9pnet: Installing 9P2000 support514gitlab # [ 2.809650] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.515gitlab # [ 2.814725] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.516gitlab # [ 2.815018] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev517gitlab # [ 2.820793] systemd[1]: Starting Create Static Device Nodes in /dev...518gitlab # [ 2.825482] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.519gitlab # [ 2.835726] systemd[1]: Finished Load Kernel Module 9pnet_virtio.520gitlab # [ 2.843742] systemd[1]: Finished Load Kernel Modules.521gitlab # [ 2.847677] systemd[1]: Finished Create Static Device Nodes in /dev.522gitlab # [ 2.850352] systemd[1]: Reached target Preparation for Local File Systems.523gitlab # [ 2.852512] systemd[1]: Reached target Local File Systems.524gitlab # [ 2.856611] systemd[1]: Starting Apply Kernel Variables...525gitlab # [ 2.868131] systemd[1]: Starting Rule-based Manager for Device Events and Files...526gitlab # [ 2.874844] systemd[1]: Finished Apply Kernel Variables.527gitlab # [ 2.612553] systemd-modules-load[153]: Using 4 probe threads528gitlab # [ 2.879201] systemd[1]: Started Journal Service.529gitlab # [ 2.615140] systemd-modules-load[153]: Inserted module 'virtio_balloon'530gitlab # [ 2.617436] systemd-modules-load[153]: Inserted module 'virtio_gpu'531gitlab # [ 2.619283] systemd-modules-load[153]: Inserted module 'dm_mod'532gitlab # [ 2.620943] systemd[1]: Starting Create System Files and Directories...533gitlab # [ 2.628444] systemd-udevd[182]: Using default interface naming scheme 'v260'.534gitlab # [ 2.639849] systemd[1]: Finished Create System Files and Directories.535gitlab # [ 2.648850] systemd[1]: Started Rule-based Manager for Device Events and Files.536gitlab # [ 2.702282] systemd[1]: Finished Coldplug All udev Devices.537gitlab # [ 2.703972] systemd[1]: Reached target System Initialization.538gitlab # [ 2.705410] systemd[1]: Reached target Basic System.539gitlab # [ 3.077352] virtio_blk virtio4: 4/0/0 default/read/poll queues540gitlab # [ 3.100683] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)541gitlab # [ 3.109179] uhci_hcd 0000:00:01.2: UHCI Host Controller542gitlab # [ 3.110584] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1543gitlab # [ 3.112669] uhci_hcd 0000:00:01.2: detected 2 ports544gitlab # [ 3.115643] SCSI subsystem initialized545gitlab # [ 3.120057] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140546gitlab # [ 3.121918] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18547gitlab # [ 3.123930] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1548gitlab # [ 3.125746] usb usb1: Product: UHCI Host Controller549gitlab # [ 3.127091] usb usb1: Manufacturer: Linux 6.18.34 uhci_hcd550gitlab # [ 3.128645] usb usb1: SerialNumber: 0000:00:01.2551gitlab # [ 3.135177] hub 1-0:1.0: USB hub found552gitlab # [ 3.135206] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12553gitlab # [ 3.135573] hub 1-0:1.0: 2 ports detected554gitlab # [ 3.140657] serio: i8042 KBD port at 0x60,0x64 irq 1555gitlab # [ 3.141899] serio: i8042 AUX port at 0x60,0x64 irq 12556gitlab # [ 3.142219] virtio_blk virtio5: 4/0/0 default/read/poll queues557gitlab # [ 3.147802] virtio_blk virtio5: [vdb] 11450736 512-byte logical blocks (5.86 GB/5.46 GiB)558gitlab # [ 3.158928] scsi host0: ata_piix559gitlab # [ 3.160470] scsi host1: ata_piix560gitlab # [ 3.161463] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0561gitlab # [ 3.163286] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0562gitlab # [ 2.923222] (udev-worker)[222]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.563gitlab # [ 2.926943] (udev-worker)[222]: Network interface NamePolicy= disabled on kernel command line.564gitlab # [ 2.929054] systemd[1]: Starting Virtual Console Setup...565gitlab # [ 2.930991] (udev-worker)[201]: Network interface NamePolicy= disabled on kernel command line.566gitlab # [ 2.951852] systemd-vconsole-setup[231]: Configuration of first virtual console was skipped, ignoring remaining ones.567gitlab # [ 2.955654] systemd[1]: Found device /dev/disk/by-label/nixos.568gitlab # [ 2.959389] systemd[1]: Finished Virtual Console Setup.569gitlab # [ 2.963842] systemd[1]: Found device /dev/disk/by-label/nix-store.570gitlab # [ 2.965354] systemd[1]: Reached target Initrd Root Device.571gitlab # [ 2.968674] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...572gitlab # [ 2.991992] systemd-fsck[242]: nixos: clean, 12/65536 files, 13019/262144 blocks573gitlab # [ 2.999346] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.574gitlab # [ 3.328236] ata2: found unknown device (class 0)575gitlab # [ 3.332332] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100576gitlab # [ 3.339577] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5577gitlab # [ 3.377816] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0578gitlab # [ 3.378114] usb 1-1: new full-speed USB device number 2 using uhci_hcd579gitlab # [ 3.415269] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray580gitlab # [ 3.446302] cdrom: Uniform CD-ROM driver Revision: 3.20581gitlab # [ 3.555508] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00582gitlab # [ 3.560299] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10583gitlab # [ 3.564645] usb 1-1: Product: QEMU USB Tablet584gitlab # [ 3.567503] usb 1-1: Manufacturer: QEMU585gitlab # [ 3.570105] usb 1-1: SerialNumber: 28754-0000:00:01.2-1586gitlab # [ 3.609713] hid: raw HID events driver (C) Jiri Kosina587gitlab # [ 3.620018] usbcore: registered new interface driver usbhid588gitlab # [ 3.621448] usbhid: USB HID core driver589gitlab # [ 3.629549] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2590gitlab # [ 3.632799] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0591gitlab # [ 3.504843] systemd[1]: Mounting /sysroot...592gitlab # [ 3.946118] EXT4-fs (vda): mounted filesystem d6a6e71f-69b7-43a0-9694-85abb869ea25 r/w with ordered data mode. Quota mode: none.593gitlab # [ 3.686401] systemd[1]: Mounted /sysroot.594gitlab # [ 3.688475] systemd[1]: Reached target Initrd Root File System.595gitlab # [ 3.692468] systemd[1]: Mounting /sysroot/nix/.ro-store...596gitlab # [ 3.694775] systemd[1]: Mounting /sysroot/nix/.rw-store...597gitlab # [ 3.697828] systemd[1]: Mounting /sysroot/run...598gitlab # [ 3.706196] systemd[1]: Mounting /sysroot/tmp/shared...599gitlab # [ 3.712262] systemd[1]: Mounting /sysroot/tmp/xchg...600gitlab # [ 3.718690] systemd[1]: Starting Mountpoints Configured in the Real Root...601gitlab # [ 3.986900] 9p: Installing v9fs 9p2000 file system support602gitlab # [ 3.988146] erofs (device vdb): mounted with root inode @ nid 128.603gitlab # [ 3.727665] systemd[1]: Mounted /sysroot/nix/.ro-store.604gitlab # [ 3.729555] systemd[1]: Mounted /sysroot/nix/.rw-store.605gitlab # [ 3.731160] systemd[1]: Mounted /sysroot/run.606gitlab # [ 3.732748] systemd-sysroot-fstab-check[272]: /sysroot should be mounted in the initrd, will request daemon-reload.607gitlab # [ 3.735324] systemd[1]: Mounted /sysroot/tmp/shared.608gitlab # [ 3.736694] systemd[1]: Mounted /sysroot/tmp/xchg.609gitlab # [ 3.739813] systemd[1]: Starting rw-sysroot-nix-store.service...610gitlab # [ 3.741343] systemd[1]: Reload requested from client PID 272 ('systemd-sysroot') (unit initrd-parse-etc.service)...611gitlab # [ 3.744001] systemd[1]: Reloading...612gitlab # [ 3.979574] systemd[1]: Reloading finished in 238 ms.613gitlab # [ 4.031994] systemd-sysroot-fstab-check[272]: Requesting initrd-fs.target/start/replace...614gitlab # [ 4.202723] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.615gitlab # [ 4.208464] systemd[1]: Finished rw-sysroot-nix-store.service.616gitlab # [ 4.219758] systemd-sysroot-fstab-check[272]: Requesting swap.target/start/replace...617gitlab # [ 4.232137] systemd[1]: Starting rw-sysroot-nix-store.service...618gitlab # [ 4.235767] systemd[1]: initrd-parse-etc.service: Deactivated successfully.619gitlab # [ 4.241130] systemd[1]: Finished Mountpoints Configured in the Real Root.620gitlab # [ 4.245200] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.621gitlab # [ 4.256191] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.622gitlab # [ 4.264599] systemd[1]: Finished rw-sysroot-nix-store.service.623gitlab # [ 4.505830] systemd[1]: Mounting /sysroot/nix/store...624gitlab # [ 4.562766] systemd[1]: Mounted /sysroot/nix/store.625gitlab # [ 4.566457] systemd[1]: Reached target Initrd File Systems.626gitlab # [ 4.574185] systemd[1]: Starting Find NixOS closure...627gitlab # [ 4.580468] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...628gitlab # [ 4.615976] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.629gitlab # [ 4.620534] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.630gitlab # [ 4.642943] systemd[1]: Finished Find NixOS closure.631gitlab # [ 4.646757] systemd[1]: Reached target Initrd Default Target.632gitlab # [ 4.653903] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...633gitlab # [ 4.693698] systemd[1]: Stopped target Initrd Default Target.634gitlab # [ 4.697337] systemd[1]: Stopped target Basic System.635gitlab # [ 4.700514] systemd[1]: Stopped target Initrd Root Device.636gitlab # [ 4.703842] systemd[1]: Stopped target Path Units.637gitlab # [ 4.706848] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.638gitlab # [ 4.711490] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.639gitlab # [ 4.715942] systemd[1]: Stopped target Slice Units.640gitlab # [ 4.719197] systemd[1]: Stopped target Socket Units.641gitlab # [ 4.722485] systemd[1]: Stopped target System Initialization.642gitlab # [ 4.725851] systemd[1]: Stopped target Swaps.643gitlab # [ 4.728468] systemd[1]: Stopped target Timer Units.644gitlab # [ 4.731297] systemd[1]: dbus.socket: Deactivated successfully.645gitlab # [ 4.734190] systemd[1]: Closed D-Bus System Message Bus Socket.646gitlab # [ 4.736966] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.647gitlab # [ 4.740409] systemd[1]: Stopped Find NixOS closure.648gitlab # [ 4.742737] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio649gitlab # [ 4.747526] systemd[1]: Starting rw-sysroot-nix-store.service...650gitlab # [ 4.749851] systemd[1]: systemd-sysctl.service: Deactivated successfully.651gitlab # [ 4.752467] systemd[1]: Stopped Apply Kernel Variables.652gitlab # [ 4.753799] systemd[1]: systemd-modules-load.service: Deactivated successfully.653gitlab # [ 4.755557] systemd[1]: Stopped Load Kernel Modules.654gitlab # [ 4.758103] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.655gitlab # [ 4.760042] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.656gitlab # [ 4.764881] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.657gitlab # [ 4.766646] systemd[1]: Stopped Create System Files and Directories.658gitlab # [ 4.771883] systemd[1]: Stopped target Local File Systems.659gitlab # [ 4.773291] systemd[1]: Stopped target Preparation for Local File Systems.660gitlab # [ 4.774961] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.661gitlab # [ 4.776698] systemd[1]: Stopped Coldplug All udev Devices.662gitlab # [ 4.779740] systemd[1]: Stopping Rule-based Manager for Device Events and Files...663gitlab # [ 4.781924] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.664gitlab # [ 4.784564] systemd[1]: Stopped Virtual Console Setup.665gitlab # [ 4.791569] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.666gitlab # [ 4.795252] systemd[1]: Finished rw-sysroot-nix-store.service.667gitlab # [ 4.800358] systemd[1]: systemd-udevd.service: Deactivated successfully.668gitlab # [ 4.803776] systemd[1]: Stopped Rule-based Manager for Device Events and Files.669gitlab # [ 4.805482] systemd[1]: systemd-udevd.service: Consumed 1.043s CPU time over 2.197s wall clock time, 24.7M memory peak.670gitlab # [ 4.814047] systemd[1]: initrd-cleanup.service: Deactivated successfully.671gitlab # [ 4.817572] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.672gitlab # [ 4.824104] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.673gitlab # [ 4.825851] systemd[1]: Closed udev Control Socket.674gitlab # [ 4.829796] systemd[1]: Starting Cleanup udev Database...675gitlab # [ 4.831189] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.676gitlab # [ 4.833057] systemd[1]: Stopped Create Static Device Nodes in /dev.677gitlab # [ 4.834628] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.678gitlab # [ 4.836508] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.679gitlab # [ 4.842613] systemd[1]: kmod-static-nodes.service: Deactivated successfully.680gitlab # [ 4.844295] systemd[1]: Stopped Create List of Static Device Nodes.681gitlab # [ 4.856258] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.682gitlab # [ 4.860608] systemd[1]: Finished Cleanup udev Database.683gitlab # [ 4.867810] systemd[1]: Reached target Switch Root.684gitlab # [ 4.873665] systemd[1]: Starting NixOS Activation...685gitlab # [ 5.010980] initrd-nixos-activation-start[569]: booting system configuration /nix/store/q5drwqwazvjnw813clgrd23jd7lz3x47-nixos-system-gitlab-test686gitlab # [ 5.064858] initrd-nixos-activation-start[569]: running activation script...687gitlab # [ 5.330601] initrd-nixos-activation-start[592]: setting up /etc...688gitlab # [ 5.487696] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.689gitlab # [ 5.495287] systemd[1]: Finished NixOS Activation.690gitlab # [ 5.520827] systemd[1]: Starting Switch Root...691gitlab # [ 5.556599] systemd[1]: Switching root.692gitlab # [ 6.269315] systemd-journald[150]: Received SIGTERM from PID 1 (systemd).693gitlab # [ 6.384991] NET: Registered PF_VSOCK protocol family694gitlab # [ 6.756186] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)695gitlab # [ 6.772522] systemd[1]: Detected virtualization kvm.696gitlab # [ 6.775758] systemd[1]: Detected architecture x86-64.697gitlab # [ 6.779173] systemd[1]: Detected first boot.698gitlab # [ 6.783227] systemd[1]: Initializing machine ID from random generator.699gitlab # [ 6.925007] systemd[1]: bpf-restrict-fs: LSM BPF program attached700gitlab # [ 6.994413] systemd[1]: Applying preset policy.701gitlab # [ 7.154468] systemd[1]: Populated /etc with preset unit settings.702gitlab # [ 7.284988] systemd[1]: initrd-switch-root.service: Deactivated successfully.703gitlab # [ 7.287289] systemd[1]: Stopped initrd-switch-root.service.704gitlab # [ 7.290894] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.705gitlab # [ 7.294122] systemd[1]: Created slice Slice /system/getty.706gitlab # [ 7.296294] systemd[1]: Created slice GitLab DevOps Platform Slice.707gitlab # [ 7.298553] systemd[1]: Created slice User and Session Slice.708gitlab # [ 7.300180] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.709gitlab # [ 7.302210] systemd[1]: Started Forward Password Requests to Wall Directory Watch.710gitlab # [ 7.304043] systemd[1]: Expecting device /dev/hvc0...711gitlab # [ 7.305326] systemd[1]: Expecting device /dev/ttyS0...712gitlab # [ 7.306669] systemd[1]: Reached target Local Encrypted Volumes.713gitlab # [ 7.308150] systemd[1]: Stopped target initrd-fs.target.714gitlab # [ 7.309585] systemd[1]: Stopped target initrd-root-fs.target.715gitlab # [ 7.311055] systemd[1]: Stopped target initrd-switch-root.target.716gitlab # [ 7.312588] systemd[1]: Reached target Virtual Machines and Containers.717gitlab # [ 7.314202] systemd[1]: Reached target Path Units.718gitlab # [ 7.315497] systemd[1]: Reached target Remote File Systems.719gitlab # [ 7.316981] systemd[1]: Reached target Slice Units.720gitlab # [ 7.318337] systemd[1]: Reached target Swaps.721gitlab # [ 7.320642] systemd[1]: Listening on Process Core Dump Socket.722gitlab # [ 7.322800] systemd[1]: Listening on Credential Encryption/Decryption.723gitlab # [ 7.326295] systemd[1]: Starting Journal Log Access Socket...724gitlab # [ 7.328732] systemd[1]: Listening on Journal Audit Socket.725gitlab # [ 7.330547] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.726gitlab # [ 7.332493] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki727gitlab # [ 7.335011] systemd[1]: Listening on udev Control Socket.728gitlab # [ 7.338639] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 7.341758] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 7.344907] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 7.348396] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 7.361585] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 7.363453] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 7.369719] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 7.371249] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 7.386739] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 7.386828] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 7.388473] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 7.394901] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 7.400902] systemd[1]: Starting Journal Service...741gitlab # [ 7.406118] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 7.410041] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 7.419204] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 7.422394] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki745gitlab # [ 7.430034] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 7.438896] systemd[1]: Listening on Journal Log Access Socket.747gitlab # [ 7.441010] systemd-journald[804]: Collecting audit messages is enabled.748gitlab # [ 7.441307] systemd[1]: Mounted Huge Pages File System.749gitlab # [ 7.444201] systemd[1]: Mounted POSIX Message Queue File System.750gitlab # [ 7.446240] systemd[1]: Mounted Kernel Debug File System.751gitlab # [ 7.447918] systemd[1]: Mounted Kernel Trace File System.752gitlab # [ 7.449308] EXT4-fs (vda): re-mounted d6a6e71f-69b7-43a0-9694-85abb869ea25.753gitlab # [ 7.450343] loop: module loaded754gitlab # [ 7.453251] systemd[1]: Finished Create List of Static Device Nodes.755gitlab # [ 7.455850] systemd[1]: modprobe@configfs.service: Deactivated successfully.756gitlab # [ 7.458428] systemd[1]: Finished Load Kernel Module configfs.757gitlab # [ 7.195055] systemd[1]: Queued start job for default target Multi-User System.758gitlab # [ 7.197286] systemd[1]: Unnecessary job was removed for /dev/vdb.759gitlab # [ 7.462000] systemd[1]: Started Journal Service.760gitlab # [ 7.199302] systemd[1]: systemd-journald.service: Deactivated successfully.761gitlab # [ 7.201752] systemd-modules-load[805]: Using 3 probe threads762gitlab # [ 7.203684] systemd-modules-load[805]: Inserted module 'tls'763gitlab # [ 7.205444] systemd-modules-load[805]: Inserted module 'loop'764gitlab # [ 7.207240] systemd[1]: Mounted FUSE Control File System.765gitlab # [ 7.208957] systemd[1]: Finished Load Kernel Modules.766gitlab # [ 7.210823] systemd[1]: Finished Remount Root and Kernel File Systems.767gitlab # [ 7.212929] systemd-oomd[806]: No swap; memory pressure usage will be degraded768gitlab # [ 7.215502] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.769gitlab # [ 7.225737] systemd[1]: Mounting Kernel Configuration File System...770gitlab # [ 7.229372] systemd[1]: Starting Firewall...771gitlab # [ 7.237271] systemd[1]: Starting Flush Journal to Persistent Storage...772gitlab # [ 7.239235] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore773gitlab # [ 7.245113] systemd[1]: Starting Load/Save OS Random Seed...774gitlab # [ 7.246556] systemd[1]: Starting Apply Kernel Variables...775gitlab # [ 7.250504] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...776gitlab # [ 7.252551] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki777gitlab # [ 7.262113] systemd[1]: Mounted Kernel Configuration File System.778gitlab # [ 7.536250] systemd-journald[804]: Received client request to flush runtime journal.779gitlab # [ 7.340828] systemd[1]: Finished Apply Kernel Variables.780gitlab # [ 7.342583] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.781gitlab # [ 7.344738] systemd[1]: Finished Load/Save OS Random Seed.782gitlab # [ 7.346358] systemd[1]: Reached target First Boot Complete.783gitlab # [ 7.347694] systemd[1]: Starting Create Static Device Nodes in /dev...784gitlab # [ 7.349250] systemd[1]: Finished Create Static Device Nodes in /dev.785gitlab # [ 7.350845] systemd[1]: Reached target Preparation for Local File Systems.786gitlab # [ 7.352549] systemd[1]: Starting Rule-based Manager for Device Events and Files...787gitlab # [ 7.354350] systemd[1]: Finished Flush Journal to Persistent Storage.788gitlab # [ 7.365925] systemd-udevd[847]: Using default interface naming scheme 'v260'.789gitlab # [ 7.376378] systemd[1]: Finished Coldplug All udev Devices.790gitlab # [ 7.403861] systemd[1]: Started Rule-based Manager for Device Events and Files.791gitlab # [ 7.531512] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse792gitlab # [ 7.549279] systemd[1]: Finished Firewall.793gitlab # [ 7.580489] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 7.608753] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.795gitlab # [ 7.611580] (udev-worker)[930]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.796gitlab # [ 7.615382] (udev-worker)[930]: Network interface NamePolicy= disabled on kernel command line.797gitlab # [ 7.617929] (udev-worker)[923]: Network interface NamePolicy= disabled on kernel command line.798gitlab # [ 7.634658] systemd[1]: Condition check resulted in Virtio network device being skipped.799gitlab # [ 7.636961] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore800gitlab # [ 7.640776] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67801gitlab # [ 7.645131] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore802gitlab # [ 7.647944] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki803gitlab # [ 7.650421] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki804gitlab # [ 7.919560] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3805gitlab # [ 7.925183] ACPI: button: Power Button [PWRF]806gitlab # [ 7.936421] mousedev: PS/2 mouse device common for all mice807gitlab # [ 7.961720] Floppy drive(s): fd0 is 2.88M AMI BIOS808gitlab # [ 7.964048] rtc_cmos 00:05: RTC can wake from S4809gitlab # [ 7.966908] parport_pc 00:03: reported by Plug and Play ACPI810gitlab # [ 7.975870] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]811gitlab # [ 7.977472] FDC 0 is a S82078B812gitlab # [ 7.981333] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console813gitlab # [ 7.991644] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0814gitlab # [ 7.991725] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD815gitlab # [ 7.996880] Console: switching to colour dummy device 80x25816gitlab # [ 8.001367] [drm] Found bochs VGA, ID 0xb0c5.817gitlab # [ 8.001369] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.818gitlab # [ 8.002197] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5819gitlab # [ 8.006528] rtc_cmos 00:05: registered as rtc0820gitlab # [ 8.008105] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic821gitlab # [ 8.008170] rtc_cmos 00:05: setting system clock to 2026-07-12T13:10:26 UTC (1783861826)822gitlab # [ 8.010001] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0823gitlab # [ 8.013600] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6824gitlab # [ 8.015524] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4825gitlab # [ 8.017717] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs826gitlab # [ 8.019148] fbcon: bochs-drmdrmfb (fb0) is primary device827gitlab # [ 8.025334] Console: switching to colour frame buffer device 160x50828gitlab # [ 8.027196] systemd-journald[804]: Time jumped backwards, rotating.829gitlab # [ 8.028483] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device830gitlab # [ 7.826797] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 7.836473] systemd[1]: syste[ 8.101476] ppdev: user-space parallel port driver832gitlab # md-vconsole-setup.service: Deactivated successfully.833gitlab # [ 7.840968] systemd[1]: Stopped Virtual Console Setup.834gitlab # [ 7.849887] systemd[1]: Starting Virtual Console Setup...835gitlab # [ 7.872926] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.836gitlab # [ 7.878348] systemd[1]: Stopped Virtual Console Setup.837gitlab # [ 7.884654] systemd[1]: Starting Virtual Console Setup...838gitlab # [ 7.945870] systemd-vconsole-setup[979]: Configuration of first virtual console was skipped, ignoring remaining ones.839gitlab # [ 7.949363] systemd[1]: Finished Virtual Console Setup.840gitlab # [ 8.023326] systemd[1]: Mount[ 8.288632] kvm_amd: TSC scaling supported841gitlab # ing /run/wrappers...842gitlab # [ 8.290007] kvm_amd: Nested Virtualization enabled843gitlab # [ 8.291180] kvm_amd: Nested Paging enabled844gitlab # [ 8.292105] kvm_amd: LBR virtualization supported845gitlab # [ 8.293117] kvm_amd: Virtual VMLOAD VMSAVE supported846gitlab # [ 8.294161] kvm_amd: Virtual GIF supported847gitlab # [ 8.295039] kvm_amd: Virtual NMI enabled848gitlab # [ 8.072753] systemd[1]: Mounted /run/wrappers.849gitlab # [ 8.077051] systemd[1]: Reached target Local File Systems.850gitlab # [ 8.078634] systemd[1]: Listening on Boot Loader Control Service Socket.851gitlab # [ 8.081697] systemd[1]: Starting register-nix-paths.service...852gitlab # [ 8.086666] systemd[1]: Starting Create SUID/SGID Wrappers...853gitlab # [ 8.089371] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.854gitlab # [ 8.356691] EDAC MC: Ver: 3.0.0855gitlab # [ 8.095077] systemd[1]: Starting Save Transient machine-id to Disk...856gitlab # [ 8.100258] systemd[1]: Starting Create System Files and Directories...857gitlab # [ 8.135581] systemd[1]: Finished Create System Files and Directories.858gitlab # [ 8.139712] systemd[1]: Starting Rebuild Journal Catalog...859gitlab # [ 8.143310] systemd[1]: Starting Record System Boot/Shutdown in UTMP...860gitlab # [ 8.147783] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.861gitlab # [ 8.151169] systemd[1]: Finished Save Transient machine-id to Disk.862gitlab # [ 8.167330] systemd[1]: Finished Record System Boot/Shutdown in UTMP.863gitlab # [ 8.181705] systemd[1]: Finished Rebuild Journal Catalog.864gitlab # [ 8.183613] systemd[1]: Starting Update is Completed...865gitlab # [ 8.201227] systemd[1]: Finished Update is Completed.866gitlab # [ 8.241460] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.867gitlab # [ 8.243332] systemd[1]: Finished Create SUID/SGID Wrappers.868gitlab # [ 8.244657] systemd[1]: suid-sgid-wrappers.service: Consumed 124ms CPU time over 156ms wall clock time, 4.6M memory peak, 1.1M read from disk.869gitlab # [ 8.497866] systemd[1]: Finished register-nix-paths.service.870gitlab # [ 8.501666] systemd[1]: Reached target System Initialization.871gitlab # [ 8.505217] systemd[1]: Started Discard unused filesystem blocks once a week.872gitlab # [ 8.509529] systemd[1]: Started logrotate.timer.873gitlab # [ 8.512496] systemd[1]: Started Daily Cleanup of Temporary Directories.874gitlab # [ 8.516485] systemd[1]: Reached target Timer Units.875gitlab # [ 8.519606] systemd[1]: Listening on D-Bus System Message Bus Socket.876gitlab # [ 8.523499] systemd[1]: Listening on Nix Daemon Socket.877gitlab # [ 8.526724] systemd[1]: Starting nixbot CI service socket...878gitlab # [ 8.530327] systemd[1]: Listening on Hostname Service Socket.879gitlab # [ 8.534135] systemd[1]: Listening on nixbot CI service socket.880gitlab # [ 8.538486] systemd[1]: Reached target Socket Units.881gitlab # [ 8.541649] systemd[1]: Starting D-Bus System Message Bus...882gitlab # [ 8.569618] dbus-broker-launch[1069]: Looking up NSS user entry for 'systemd-timesync'...883gitlab # [ 8.575268] dbus-broker-launch[1069]: NSS returned no entry for 'systemd-timesync'884gitlab # [ 8.579711] dbus-broker-launch[1069]: Invalid user-name in /nix/store/89zj9nmrajvcy9c3c08wv0ir9ww7lgmq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"885gitlab # [ 8.588772] systemd[1]: Started D-Bus System Message Bus.886gitlab # [ 8.607204] dbus-broker-launch[1069]: Ready887gitlab # [ 8.611923] systemd[1]: Reached target Basic System.888gitlab # [ 8.616091] systemd[1]: Started backdoor.service.889gitlab # [ 8.620556] systemd[1]: Starting gitlab-config.service...890gitlab # [ 8.624849] systemd[1]: Starting Import lastlog data into lastlog2 database...891gitlab # [ 8.644679] systemd[1]: Starting Logrotate configuration check...892gitlab # [ 8.651855] systemd[1]: Starting Name Service Cache Daemon (nsncd)...893gitlab # connecting to host...894gitlab # [ 8.658602] systemd[1]: Starting Post-Boot Actions...895gitlab # [ 8.668104] systemd[1]: Started Reset console on configuration changes.896gitlab # [ 8.673524] systemd[1]: Starting resolvconf update...897gitlab # [ 8.675204] logrotate[1074]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.898gitlab: Guest shell says: b'Spawning backdoor root shell...\n'899gitlab # [ 8.679744] logrotate[1074]: reading config file /nix/store/sn4bd2nqi3yg4r51djm9i2rmfgbwvmhb-logrotate.conf900gitlab # [ 8.680767] logrotate[1074]: note: 'monthly' overrides previously specified 'weekly'901gitlab: connected to guest root shell902gitlab # [ 8.683261] logrotate[1074]: Reading state from file: /var/lib/logrotate.status903gitlab: (connecting took 9.55 seconds)904gitlab # [ 8.684247] logrotate[1074]: state file /var/lib/logrotate.status does not exist905gitlab: (finished: waiting for the VM to finish booting, in 9.55 seconds)906gitlab # [ 8.685052] logrotate[1074]: Allocating hash table for state file, size 64 entries907gitlab # [ 8.685920] logrotate[1074]: Handling 4 logs908gitlab # [ 8.689243] logrotate[1074]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed909gitlab # [ 8.690276] logrotate[1074]: considering log /var/log/btmp910gitlab # [ 8.693317] logrotate[1074]: Creating new state911gitlab # [ 8.694127] logrotate[1074]: Now: 2026-07-12 13:10912gitlab # [ 8.695217] logrotate[1074]: Last rotated at 2026-07-12 13:00913gitlab # [ 8.695825] logrotate[1074]: log does not need rotating (log has already been rotated)914gitlab # [ 8.698941] logrotate[1074]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed915gitlab # [ 8.701222] logrotate[1074]: considering log /var/log/wtmp916gitlab # [ 8.702869] logrotate[1074]: Creating new state917gitlab # [ 8.706503] logrotate[1074]: Now: 2026-07-12 13:10918gitlab # [ 8.707959] logrotate[1074]: Last rotated at 2026-07-12 13:00919gitlab # [ 8.708956] logrotate[1074]: log does not need rotating (log has already been rotated)920gitlab # [ 8.710598] logrotate[1074]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed921gitlab # [ 8.711809] logrotate[1074]: switching euid from 0 to 165 and egid from 0 to 165 (pid 1074)922gitlab # [ 8.712946] logrotate[1074]: considering log /var/gitlab/state/log/*.log923gitlab # [ 8.714105] logrotate[1074]: log /var/gitlab/state/log/*.log does not exist -- skipping924gitlab # [ 8.714916] logrotate[1074]: Creating new state925gitlab # [ 8.716066] logrotate[1074]: switching euid from 165 to 0 and egid from 165 to 0 (pid 1074)926gitlab # [ 8.716907] logrotate[1074]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed927gitlab # [ 8.719692] logrotate[1074]: switching euid from 0 to 60 and egid from 0 to 60 (pid 1074)928gitlab # [ 8.720847] logrotate[1074]: considering log /var/log/nginx/*.log929gitlab # [ 8.721982] logrotate[1074]: log /var/log/nginx/*.log does not exist -- skipping930gitlab # [ 8.723152] logrotate[1074]: Creating new state931gitlab # [ 8.725216] logrotate[1074]: switching euid from 60 to 0 and egid from 60 to 0 (pid 1074)932gitlab # [ 8.726329] systemd[1]: Finished Logrotate configuration check.933gitlab # [ 8.727474] nsncd[1075]: Jul 12 13:10:27.461 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"934gitlab # [ 8.728704] systemd[1]: Finished Post-Boot Actions.935gitlab # [ 8.730793] systemd[1]: Started Name Service Cache Daemon (nsncd).936gitlab # [ 8.732639] systemd[1]: Finished Import lastlog data into lastlog2 database.937gitlab # [ 8.750296] systemd[1]: Reached target Host and Network Name Lookups.938gitlab # [ 8.751493] systemd[1]: Reached target User and Group Name Lookups.939gitlab # [ 8.755214] systemd[1]: Starting User Login Management...940gitlab # [ 8.764990] systemd[1]: Stopped target Host and Network Name Lookups.941gitlab # [ 8.766615] systemd[1]: Stopping Host and Network Name Lookups...942gitlab # [ 8.768391] systemd[1]: Stopped target User and Group Name Lookups.943gitlab # [ 8.769966] systemd[1]: Stopping User and Group Name Lookups...944gitlab # [ 8.771879] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...945gitlab # [ 8.774523] systemd[1]: nscd.service: Deactivated successfully.946gitlab # [ 8.777276] systemd[1]: Stopped Name Service Cache Daemon (nsncd).947gitlab # [ 8.778453] systemd[1]: nscd.service: Consumed 27ms CPU time over 122ms wall clock time, 7.9M memory peak, 5.7M read from disk.948gitlab # [ 8.787466] systemd[1]: Starting Name Service Cache Daemon (nsncd)...949gitlab # [ 8.801161] systemd[1]: Finished resolvconf update.950gitlab # [ 8.802606] systemd[1]: Reached target Preparation for Network.951gitlab # [ 8.805444] systemd[1]: Starting DHCP Client...952gitlab # [ 8.809636] systemd[1]: Starting Address configuration of eth1...953gitlab # [ 8.812909] systemd[1]: Starting Extra networking commands....954gitlab # [ 8.817378] systemd[1]: Started Name Service Cache Daemon (nsncd).955gitlab # [ 8.819652] nsncd[1163]: Jul 12 13:10:27.573 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"956gitlab # [ 8.824308] systemd-logind[1136]: New seat seat0.957gitlab # [ 8.825625] systemd[1]: Reached target Host and Network Name Lookups.958gitlab # [ 8.828668] systemd[1]: Reached target User and Group Name Lookups.959gitlab # [ 8.830399] systemd-logind[1136]: Watching system buttons on /dev/input/event2 (Power Button)960gitlab # [ 8.831831] systemd-logind[1136]: Watching system buttons on /dev/input/event4 (QEMU Virtio Keyboard)961gitlab # [ 8.833285] systemd-logind[1136]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)962gitlab # [ 8.834120] systemd[1]: Started User Login Management.963gitlab # [ 8.835216] systemd[1]: Starting linger-users.service...964gitlab # [ 8.852870] systemd[1]: linger-users.service: Deactivated successfully.965gitlab # [ 8.856626] systemd[1]: Finished linger-users.service.966gitlab # [ 8.863827] network-addresses-eth1-start[1174]: adding address 192.168.1.1/24... done967gitlab # [ 8.868724] network-addresses-eth1-start[1174]: adding address 2001:db8:1::1/64... done968gitlab # [ 8.874081] systemd[1]: Finished Address configuration of eth1.969gitlab # [ 8.907466] dhcpcd[1193]: dhcpcd-10.3.2 starting970gitlab # [ 8.909914] dhcpcd[1237]: dev: loaded udev971gitlab # [ 9.182528] 8021q: 802.1Q VLAN Support v1.8972gitlab # [ 9.183553] 8021q: adding VLAN 0 to HW filter on device eth1973gitlab # [ 8.921407] systemd[1]: Finished Extra networking commands..974gitlab # [ 8.924625] systemd[1]: Reached target Network.975gitlab # [ 8.930543] systemd[1]: Starting gitlab-workhorse.service...976gitlab # [ 8.934689] systemd[1]: Starting Nginx Web Server...977gitlab # [ 8.939671] systemd[1]: Starting PostgreSQL Server...978gitlab # [ 8.946316] systemd[1]: Starting Redis Server - redis-gitlab...979gitlab # [ 8.949249] systemd[1]: Starting Permit User Sessions...980gitlab # [ 8.964191] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.981gitlab # [ 8.974200] systemd[1]: Finished Permit User Sessions.982gitlab # [ 8.988892] systemd[1]: Started Getty on tty1.983gitlab # [ 8.989996] systemd[1]: Reached target Login Prompts.984gitlab # [ 9.279138] cfg80211: Loading compiled-in X.509 certificates for regulatory database985gitlab # [ 9.290152] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'986gitlab # [ 9.291425] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'987gitlab # [ 9.293814] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2988gitlab # [ 9.295513] cfg80211: failed to load regulatory.db989gitlab # [ 9.320694] 8021q: adding VLAN 0 to HW filter on device eth0990gitlab # [ 9.057911] dhcpcd[1237]: eth0: waiting for carrier991gitlab # [ 9.059669] dhcpcd[1237]: eth0: carrier acquired992gitlab # [ 9.067694] dhcpcd[1237]: DUID 00:01:00:01:31:e6:4e:c3:52:54:00:12:34:56993gitlab # [ 9.069323] dhcpcd[1237]: eth0: IAID 00:12:34:56994gitlab # [ 9.070798] dhcpcd[1237]: eth0: adding address fe80::5054:ff:fe12:3456995gitlab # [ 9.092800] nginx-pre-start[1273]: nginx: the configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf syntax is ok996gitlab # [ 9.095374] nginx-pre-start[1273]: nginx: configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf test is successful997gitlab # [ 9.097342] redis-server[1268]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.998gitlab # [ 9.099196] redis-server[1268]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo999gitlab # [ 9.100390] redis-server[1268]: Redis version=8.8.0, bits=64, commit=00000000, modified=0, pid=1268, just started1000gitlab # [ 9.101263] redis-server[1268]: Configuration loaded1001gitlab # [ 9.102073] redis[1268]: monotonic clock: POSIX clock_gettime1002gitlab # [ 9.102992] systemd[1]: Started Redis Server - redis-gitlab.1003gitlab # [ 9.103967] redis[1268]: Running mode=standalone, port=0.1004gitlab # [ 9.105282] redis[1268]: Server initialized1005gitlab # [ 9.106408] redis[1268]: Ready to accept connections unix1006gitlab # [ 9.107291] redis[1268]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1007gitlab # [ 9.120690] postgresql-pre-start[1276]: The files belonging to this database system will be owned by user "postgres".1008gitlab # [ 9.123644] postgresql-pre-start[1276]: This user must also own the server process.1009gitlab # [ 9.126068] systemd[1]: Started Nginx Web Server.1010gitlab # [ 9.128895] postgresql-pre-start[1276]: The database cluster will be initialized with locale "en_US.UTF-8".1011gitlab # [ 9.131377] postgresql-pre-start[1276]: The default database encoding has accordingly been set to "UTF8".1012gitlab # [ 9.133941] postgresql-pre-start[1276]: The default text search configuration will be set to "english".1013gitlab # [ 9.136702] postgresql-pre-start[1276]: Data page checksums are disabled.1014gitlab # [ 9.137986] postgresql-pre-start[1276]: fixing permissions on existing directory /var/lib/postgresql/17 ... ok1015gitlab # [ 9.141499] postgresql-pre-start[1276]: creating subdirectories ... ok1016gitlab # [ 9.142922] postgresql-pre-start[1276]: selecting dynamic shared memory implementation ... posix1017gitlab # [ 9.176803] postgresql-pre-start[1276]: selecting default "max_connections" ... 1001018gitlab # [ 9.212821] postgresql-pre-start[1276]: selecting default "shared_buffers" ... 128MB1019gitlab # [ 9.443321] systemd[1]: Started gitlab-workhorse.service.1020gitlab # [ 9.603083] postgresql-pre-start[1276]: selecting default time zone ... UTC1021gitlab # [ 9.607064] postgresql-pre-start[1276]: creating configuration files ... ok1022gitlab # [ 9.669476] gitlab-workhorse[1305]: time="2026-07-12T13:10:28Z" level=info msg=Starting build_time=19700101.000000 version=18.11.41023gitlab # [ 9.670958] gitlab-workhorse[1305]: time="2026-07-12T13:10:28Z" level=info msg="Using redis/go-redis"1024gitlab # [ 9.672462] gitlab-workhorse[1305]: time="2026-07-12T13:10:28Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1025gitlab # [ 9.789220] postgresql-pre-start[1276]: running bootstrap script ... ok1026gitlab # [ 10.236982] postgresql-pre-start[1276]: performing post-bootstrap initialization ... ok1027gitlab # [ 10.587119] postgresql-pre-start[1276]: syncing data to disk ... ok1028gitlab # [ 10.589276] postgresql-pre-start[1276]: initdb: warning: enabling "trust" authentication for local connections1029gitlab # [ 10.590842] postgresql-pre-start[1276]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1030gitlab # [ 10.592395] postgresql-pre-start[1276]: Success. You can now start the database server using:1031gitlab # [ 10.593532] postgresql-pre-start[1276]: pg_ctl -D /var/lib/postgresql/17 -l logfile start1032gitlab # [ 10.649730] dhcpcd[1237]: eth0: soliciting a DHCP lease1033gitlab # [ 10.926475] NET: Registered PF_PACKET protocol family1034gitlab # [ 10.670544] dhcpcd[1237]: eth0: offered 10.0.2.15 from 10.0.2.21035gitlab # [ 10.676861] dhcpcd[1237]: eth0: probing address 10.0.2.15/241036gitlab # [ 10.724760] postgres[1330]: [1330] LOG: starting PostgreSQL 17.10 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1037gitlab # [ 10.726158] postgres[1330]: [1330] LOG: listening on IPv6 address "::1", port 54321038gitlab # [ 10.727741] postgres[1330]: [1330] LOG: listening on IPv4 address "127.0.0.1", port 54321039gitlab # [ 10.729967] postgres[1330]: [1330] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1040gitlab # [ 10.741004] postgres[1338]: [1338] LOG: database system was shut down at 2026-07-12 13:10:28 GMT1041gitlab # [ 10.748770] postgres[1330]: [1330] LOG: database system is ready to accept connections1042gitlab # [ 10.753154] systemd[1]: Started PostgreSQL Server.1043gitlab # [ 10.755579] systemd[1]: Starting PostgreSQL Setup Scripts...1044gitlab # [ 10.935115] postgresql-setup-start[1349]: CREATE DATABASE1045gitlab # [ 10.973780] postgresql-setup-start[1363]: CREATE ROLE1046gitlab # [ 10.989285] postgresql-setup-start[1365]: ALTER DATABASE1047gitlab # [ 11.016671] postgresql-setup-start[1370]: CREATE ROLE1048gitlab # [ 11.019527] systemd[1]: Finished PostgreSQL Setup Scripts.1049gitlab # [ 11.020944] systemd[1]: Reached target PostgreSQL.1050gitlab # [ 11.022786] systemd[1]: Starting gitlab-postgresql.service...1051gitlab # [ 11.161727] gitlab-postgresql-start[1378]: CREATE DATABASE1052gitlab # [ 11.198256] dhcpcd[1237]: eth0: soliciting an IPv6 router1053gitlab # [ 11.200465] dhcpcd[1237]: eth0: Router Advertisement from fe80::21054gitlab # [ 11.202393] dhcpcd[1237]: eth0: adding address fec0::5054:ff:fe12:3456/641055gitlab # [ 11.204293] dhcpcd[1237]: eth0: adding route to fec0::/641056gitlab # [ 11.206542] dhcpcd[1237]: eth0: adding default route via fe80::21057gitlab # [ 11.221814] gitlab-postgresql-start[1386]: CREATE EXTENSION1058gitlab # [ 11.269731] gitlab-postgresql-start[1389]: CREATE EXTENSION1059gitlab # [ 11.274350] systemd[1]: Finished gitlab-postgresql.service.1060gitlab # [ 11.323349] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1383]: mkdir -p /var/gitlab/state/home/.ssh: OK1061gitlab # [ 11.325493] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1383]: chmod 700 /var/gitlab/state/home/.ssh: OK1062gitlab # [ 11.385838] systemd[1]: Finished gitlab-config.service.1063gitlab # [ 11.388490] systemd[1]: Started gitaly.service.1064gitlab # [ 11.390398] systemd[1]: Starting gitlab-db-config.service...1065gitlab # [ 11.969972] gitaly[1404]: time="2026-07-12T13:10:30.725Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/2wcq0nlg508fs5wq7jnpg1lw2pib950g-gitaly.toml' and fix the errors that are printed." pid=14041066gitlab # [ 11.972857] gitaly[1404]: time="2026-07-12T13:10:30.726Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=14041067gitlab # [ 11.974636] gitaly[1404]: time="2026-07-12T13:10:30.726Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=14041068gitlab # [ 11.976224] gitaly[1404]: time="2026-07-12T13:10:30.726Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=14041069gitlab # [ 11.977973] gitaly[1404]: time="2026-07-12T13:10:30.726Z" level=info msg="Starting Gitaly" pid=1404 version=18.11.41070gitlab # [ 12.170117] gitaly[1404]: time="2026-07-12T13:10:30.926Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=199 pid=14041071gitlab # [ 12.171488] gitaly[1404]: time="2026-07-12T13:10:30.926Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=14041072gitlab # [ 12.172345] gitaly[1404]: time="2026-07-12T13:10:30.927Z" level=info msg="finished initializing command factory" duration_ms=0 pid=14041073gitlab # [ 12.173160] gitaly[1404]: time="2026-07-12T13:10:30.927Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-1404/git-exec-2570012454.d/git pid=14041074gitlab # [ 12.184679] gitaly[1404]: time="2026-07-12T13:10:30.941Z" level=info msg="finished detecting git version" duration_ms=13 pid=14041075gitlab # [ 12.185700] gitaly[1404]: time="2026-07-12T13:10:30.941Z" level=info msg="using Git version" pid=1404 version=2.53.g1076gitlab # [ 12.189091] gitaly[1404]: time="2026-07-12T13:10:30.942Z" level=info msg="clearing disk cache object folder" pid=1404 storage=default1077gitlab # [ 12.189834] gitaly[1404]: time="2026-07-12T13:10:30.942Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2176569428 pid=1404 storage=default1078gitlab # [ 12.190936] gitaly[1404]: time="2026-07-12T13:10:30.942Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2176569428 pid=1404 storage=default1079gitlab # [ 12.192157] gitaly[1404]: time="2026-07-12T13:10:30.942Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=14041080gitlab # [ 12.192876] gitaly[1404]: time="2026-07-12T13:10:30.942Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=14041081gitlab # [ 12.193981] gitaly[1404]: time="2026-07-12T13:10:30.942Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2176569428 clear_duration_ms=0 pid=1404 storage=default1082gitlab # [ 12.265876] gitaly[1404]: time="2026-07-12T13:10:31.022Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=14041083gitlab # [ 12.267170] gitaly[1404]: time="2026-07-12T13:10:31.022Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=1404 schema=unix1084gitlab # [ 12.269266] gitaly[1404]: time="2026-07-12T13:10:31.022Z" level=info msg="listening at address" address=/run/gitaly/gitaly-1404/sock.d/intern pid=1404 schema=unix1085gitlab # [ 12.269807] gitaly[1404]: time="2026-07-12T13:10:31.022Z" level=info msg="counting repositories" pid=14041086gitlab # [ 12.270756] gitaly[1404]: time="2026-07-12T13:10:31.023Z" level=info msg="starting to count repositories" pid=1404 storage_path=/var/gitlab/state/repositories1087gitlab # [ 12.271707] gitaly[1404]: time="2026-07-12T13:10:31.024Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=1404 storage_path=/var/gitlab/state/repositories1088gitlab # [ 12.272968] gitaly[1404]: time="2026-07-12T13:10:31.024Z" level=info msg="completed counting all repositories" counting_duration=0 pid=14041089gitlab # [ 12.274254] gitaly[1404]: time="2026-07-12T13:10:31.024Z" level=info msg="finished tempdir cleaner walk" pid=1404 storage=default time_ms=01090gitlab # [ 12.296678] gitaly[1404]: time="2026-07-12T13:10:31.053Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=14041091gitlab # [ 12.297522] gitaly[1404]: time="2026-07-12T13:10:31.053Z" level=info msg="Started Gitaly" duration_ms=327 pid=14041092gitlab # [ 12.303099] gitaly[1404]: time="2026-07-12T13:10:31.059Z" level=info msg="maintenance: daily scheduled" pid=1404 scheduled="2026-07-13 12:00:00 +0000 UTC"1093gitlab # [ 12.843181] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1407]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1094gitlab # [ 12.855552] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1407]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1095gitlab # [ 12.867662] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1407]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1096gitlab # [ 14.252279] gitaly[1404]: time="2026-07-12T13:10:33.007Z" level=info msg="License database preloaded" duration_ms=2281 pid=14041097gitlab # [ 15.801605] dhcpcd[1237]: eth0: leased 10.0.2.15 for 86400 seconds1098gitlab # [ 15.805445] dhcpcd[1237]: eth0: adding route to 10.0.2.0/241099gitlab # [ 15.808891] dhcpcd[1237]: eth0: adding default route via 10.0.2.21100gitlab # [ 15.943565] systemd[1]: Started DHCP Client.1101gitlab # [ 15.948400] systemd[1]: Reached target Network is Online.1102gitlab # [ 45.062629] postgres[1771]: [1771] ERROR: relation "feature_gates" does not exist at character 5231103gitlab # [ 45.064341] postgres[1771]: [1771] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1104gitlab # [ 45.067638] postgres[1771]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1105gitlab # [ 45.070978] postgres[1771]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1106gitlab # [ 45.077140] postgres[1771]: attidentity AS identity,1107gitlab # [ 45.081267] postgres[1771]: attgenerated as attgenerated1108gitlab # [ 45.085877] postgres[1771]: FROM pg_attribute a1109gitlab # [ 45.088473] postgres[1771]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1110gitlab # [ 45.090170] postgres[1771]: LEFT JOIN pg_type t ON a.atttypid = t.oid1111gitlab # [ 45.093611] postgres[1771]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1112gitlab # [ 45.096950] postgres[1771]: WHERE a.attrelid = '"feature_gates"'::regclass1113gitlab # [ 45.101052] postgres[1771]: AND a.attnum > 0 AND NOT a.attisdropped1114gitlab # [ 45.103714] postgres[1771]: ORDER BY a.attnum1115gitlab # [ 45.107121] postgres[1771]:1116gitlab # [ 45.272851] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1407]: W, [2026-07-12T13:11:04.028420 #1407] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1117gitlab # [ 49.723937] gitlab-workhorse[1305]: time="2026-07-12T13:11:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1118gitlab # [ 51.312583] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1835]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1119gitlab # [ 51.314874] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1835]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1120gitlab # [ 59.733760] gitlab-workhorse[1305]: time="2026-07-12T13:11:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1121gitlab # [ 69.368515] postgres[1919]: [1919] ERROR: relation "table_without_models" does not exist1122gitlab # [ 69.373685] postgres[1919]: [1919] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1123gitlab # [ 69.743918] gitlab-workhorse[1305]: time="2026-07-12T13:11:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1124gitlab # [ 79.753117] gitlab-workhorse[1305]: time="2026-07-12T13:11:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1125gitlab # [ 84.770167] systemd[1]: Finished gitlab-db-config.service.1126gitlab # [ 84.775206] systemd[1]: Started gitlab-sidekiq.service.1127gitlab # [ 84.781720] systemd[1]: Starting gitlab.service...1128gitlab # [ 85.135642] bundle[2131]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1129gitlab # [ 85.137732] bundle[2131]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1130gitlab # [ 85.139710] bundle[2131]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1131gitlab # [ 88.065306] sidekiq-cluster[2130]: {"severity":"INFO","time":"2026-07-12T13:11:46.803Z","message":"Starting cluster with 1 processes"}1132gitlab # [ 88.202171] bundle[2131]: {"timestamp":"2026-07-12T13:11:46.934Z","pid":2131,"message":"* Enabling systemd notification integration"}1133gitlab # [ 88.205648] bundle[2131]: {"timestamp":"2026-07-12T13:11:46.957Z","pid":2131,"message":"Puma starting in cluster mode..."}1134gitlab # [ 88.207858] bundle[2131]: {"timestamp":"2026-07-12T13:11:46.957Z","pid":2131,"message":"* Puma version: 7.2.0 (\"On The Corner\")"}1135gitlab # [ 88.210979] bundle[2131]: {"timestamp":"2026-07-12T13:11:46.957Z","pid":2131,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1136gitlab # [ 88.213820] bundle[2131]: {"timestamp":"2026-07-12T13:11:46.957Z","pid":2131,"message":"* Min threads: 0"}1137gitlab # [ 88.217106] bundle[2131]: {"timestamp":"2026-07-12T13:11:46.957Z","pid":2131,"message":"* Max threads: 4"}1138gitlab # [ 88.219107] bundle[2131]: {"timestamp":"2026-07-12T13:11:46.957Z","pid":2131,"message":"* Environment: production"}1139gitlab # [ 88.222111] bundle[2131]: {"timestamp":"2026-07-12T13:11:46.958Z","pid":2131,"message":"* Master PID: 2131"}1140gitlab # [ 88.225130] bundle[2131]: {"timestamp":"2026-07-12T13:11:46.958Z","pid":2131,"message":"* Workers: 2"}1141gitlab # [ 88.228115] bundle[2131]: {"timestamp":"2026-07-12T13:11:46.958Z","pid":2131,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1142gitlab # [ 88.231247] bundle[2131]: {"timestamp":"2026-07-12T13:11:46.958Z","pid":2131,"message":"* Preloading application"}1143gitlab # [ 89.764145] gitlab-workhorse[1305]: time="2026-07-12T13:11:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144gitlab # [ 99.767750] gitlab-workhorse[1305]: time="2026-07-12T13:11:58Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145gitlab # [ 109.778534] gitlab-workhorse[1305]: time="2026-07-12T13:12:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1146gitlab # [ 112.985145] bundle[2131]: W, [2026-07-12T13:12:11.740733 #2131] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1147gitlab # [ 117.593974] sidekiq-cluster[2163]: 2026-07-12T13:12:16.349Z pid=2163 tid=u0r INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2163, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>428810240}1148gitlab # [ 117.796551] sidekiq-cluster[2163]: W, [2026-07-12T13:12:16.552870 #2163] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1149gitlab # [ 117.840272] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:16.596Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1150gitlab # [ 119.788709] gitlab-workhorse[1305]: time="2026-07-12T13:12:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1151gitlab # [ 120.071798] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.827Z","message":"GitLab reliable fetch activated!"}1152gitlab # [ 120.078569] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.827Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1153gitlab # [ 120.098203] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.854Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1154gitlab # [ 120.108149] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.858Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1155gitlab # [ 120.111334] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.862Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1156gitlab # [ 120.114278] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.866Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1157gitlab # [ 120.116945] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.868Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1158gitlab # [ 120.119147] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.871Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1159gitlab # [ 120.121825] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.873Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1160gitlab # [ 120.125211] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.875Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1161gitlab # [ 120.127888] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.878Z","message":"Cron Jobs - added job with name expire_build_artifacts_worker in the namespace default"}1162gitlab # [ 120.130546] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.880Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1163gitlab # [ 120.132710] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.882Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1164gitlab # [ 120.135322] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.885Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1165gitlab # [ 120.136356] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.888Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1166gitlab # [ 120.138468] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.890Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1167gitlab # [ 120.140652] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.893Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1168gitlab # [ 120.143284] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.895Z","message":"Cron Jobs - added job with name environments_auto_delete_cron_worker in the namespace default"}1169gitlab # [ 120.144394] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.898Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1170gitlab # [ 120.145845] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.901Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1171gitlab # [ 120.147776] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.904Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1172gitlab # [ 120.151671] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.908Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1173gitlab # [ 120.154826] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.911Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1174gitlab # [ 120.158599] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.915Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1175gitlab # [ 120.161501] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.918Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1176gitlab # [ 120.164555] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.921Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1177gitlab # [ 120.167590] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.924Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1178gitlab # [ 120.170884] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.927Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1179gitlab # [ 120.174745] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.931Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1180gitlab # [ 120.178884] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.935Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1181gitlab # [ 120.181785] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.938Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1182gitlab # [ 120.185633] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.942Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1183gitlab # [ 120.188824] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.945Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1184gitlab # [ 120.192591] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.949Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1185gitlab # [ 120.196663] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.953Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1186gitlab # [ 120.200334] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.957Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1187gitlab # [ 120.204180] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.960Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1188gitlab # [ 120.207661] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.964Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1189gitlab # [ 120.211154] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.967Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1190gitlab # [ 120.214722] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.971Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1191gitlab # [ 120.218535] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.975Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1192gitlab # [ 120.221467] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.978Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1193gitlab # [ 120.225109] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.981Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1194gitlab # [ 120.228900] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.985Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1195gitlab # [ 120.232435] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.989Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1196gitlab # [ 120.236066] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.992Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1197gitlab # [ 120.239773] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:18.996Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1198gitlab # [ 120.243643] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.000Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1199gitlab # [ 120.247359] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.004Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1200gitlab # [ 120.250574] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.007Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1201gitlab # [ 120.254313] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.010Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1202gitlab # [ 120.257883] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.014Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1203gitlab # [ 120.261935] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.018Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1204gitlab # [ 120.265551] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.022Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1205gitlab # [ 120.269727] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.026Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1206gitlab # [ 120.281413] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.038Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1207gitlab # [ 120.285409] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.042Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1208gitlab # [ 120.288840] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.045Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1209gitlab # [ 120.292489] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.049Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1210gitlab # [ 120.295829] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.052Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1211gitlab # [ 120.299861] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.056Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1212gitlab # [ 120.303357] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.060Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1213gitlab # [ 120.306774] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.063Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1214gitlab # [ 120.310511] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.067Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1215gitlab # [ 120.314147] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.070Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1216gitlab # [ 120.318310] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.074Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1217gitlab # [ 120.322449] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.079Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1218gitlab # [ 120.351714] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.108Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1219gitlab # [ 120.358397] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.115Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1220gitlab # [ 120.364320] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.120Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1221gitlab # [ 120.371242] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.127Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1222gitlab # [ 120.377449] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.133Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1223gitlab # [ 120.384205] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.140Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1224gitlab # [ 120.391495] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.148Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1225gitlab # [ 120.397766] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.154Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1226gitlab # [ 120.404531] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.161Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1227gitlab # [ 120.410419] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.164Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1228gitlab # [ 120.413627] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.170Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1229gitlab # [ 120.422222] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.178Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1230gitlab # [ 120.430488] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.187Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1231gitlab # [ 120.441528] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.198Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1232gitlab # [ 120.447372] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.203Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1233gitlab # [ 120.453189] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.209Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1234gitlab # [ 120.457733] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.214Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1235gitlab # [ 120.463364] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.219Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1236gitlab # [ 120.469050] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.225Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1237gitlab # [ 120.473152] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.229Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1238gitlab # [ 120.476635] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.233Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1239gitlab # [ 120.480734] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.237Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1240gitlab # [ 120.484621] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.241Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1241gitlab # [ 120.488632] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.245Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1242gitlab # [ 120.492125] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.248Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1243gitlab # [ 120.495170] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.251Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1244gitlab # [ 120.499147] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.255Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1245gitlab # [ 120.501984] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.258Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1246gitlab # [ 120.505606] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.262Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1247gitlab # [ 120.508990] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.265Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1248gitlab # [ 120.513042] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.269Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1249gitlab # [ 120.516344] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.273Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1250gitlab # [ 120.519281] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.275Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1251gitlab # [ 120.522737] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.279Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1252gitlab # [ 120.534729] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.291Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1253gitlab # [ 120.537942] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.294Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1254gitlab # [ 120.541612] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.298Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1255gitlab # [ 120.545911] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.302Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1256gitlab # [ 120.549585] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.306Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1257gitlab # [ 120.553710] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.310Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1258gitlab # [ 120.557658] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.314Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1259gitlab # [ 120.561107] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.317Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1260gitlab # [ 120.564162] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.320Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1261gitlab # [ 120.568270] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.324Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1262gitlab # [ 120.571826] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:19.328Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1263gitlab # [ 129.791252] gitlab-workhorse[1305]: time="2026-07-12T13:12:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1264gitlab # [ 139.792774] gitlab-workhorse[1305]: time="2026-07-12T13:12:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1265gitlab # [ 141.491712] bundle[2131]: {"timestamp":"2026-07-12T13:12:40.247Z","pid":2131,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1266gitlab # [ 141.499766] bundle[2131]: {"timestamp":"2026-07-12T13:12:40.247Z","pid":2131,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1267gitlab # [ 141.506789] bundle[2131]: {"timestamp":"2026-07-12T13:12:40.247Z","pid":2131,"message":"! #\u003cThread:0x0000752a7ff04e88 /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1268gitlab # [ 141.525117] bundle[2131]: {"timestamp":"2026-07-12T13:12:40.247Z","pid":2131,"message":"! #\u003cThread:0x0000752a8017fa00 /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1269gitlab # [ 141.538636] bundle[2131]: {"timestamp":"2026-07-12T13:12:40.247Z","pid":2131,"message":"Use Ctrl-C to stop"}1270gitlab # [ 141.540823] bundle[2131]: {"timestamp":"2026-07-12T13:12:40.248Z","pid":2131,"message":"Sending status to systemd every 1.0 sec"}1271gitlab # [ 141.955993] bundle[2131]: {"timestamp":"2026-07-12T13:12:40.712Z","pid":2131,"message":"- Worker 0 (PID: 2673) booted in 0.4s, phase: 0"}1272gitlab # [ 141.976397] bundle[2131]: {"timestamp":"2026-07-12T13:12:40.732Z","pid":2131,"message":"- Worker 1 (PID: 2677) booted in 0.4s, phase: 0"}1273gitlab # [ 141.983914] systemd[1]: Started gitlab.service.1274gitlab # [ 141.987309] systemd[1]: Reached target Common target for all GitLab services..1275gitlab # [ 141.991820] systemd[1]: Starting setup-gitlab.service...1276gitlab # [ 142.003975] setup-gitlab-start[2701]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1277gitlab # [ 144.263190] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:43.018Z","message":"Booted Rails 7.2.3 application in production environment"}1278gitlab # [ 144.270656] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:43.019Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1279gitlab # [ 144.273932] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:43.027Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1280gitlab # [ 144.277478] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:43.027Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1281gitlab # [ 144.297957] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:43.054Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1282gitlab # [ 144.660834] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:12:43 +0000] "GET /users/sign_in HTTP/1.1" 200 10624 "" "curl/8.20.0" 26321283gitlab # [ 144.673617] setup-gitlab-start[2726]: ++ curl -fs -X POST -H 'Content-Type: application/json' -d '{"grant_type":"password","username":"root","password":"notproduction"}' http://gitlab/oauth/token1284gitlab # [ 144.683766] setup-gitlab-start[2727]: ++ jq -r .access_token1285gitlab # [ 145.520490] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:12:44 +0000] "POST /oauth/token HTTP/1.1" 200 244 "" "curl/8.20.0" 8261286gitlab # [ 145.526311] setup-gitlab-start[2701]: + BEARER=ac4d0e823d28e961d6cbbd2dd3fac36c2ec392290e9d6ba879f74248849061521287gitlab # [ 145.528654] setup-gitlab-start[2701]: + AUTH='Authorization: Bearer ac4d0e823d28e961d6cbbd2dd3fac36c2ec392290e9d6ba879f7424884906152'1288gitlab # [ 145.531256] setup-gitlab-start[2701]: + curl -fs -X PUT -H 'Authorization: Bearer ac4d0e823d28e961d6cbbd2dd3fac36c2ec392290e9d6ba879f7424884906152' 'http://gitlab/api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true'1289gitlab # [ 145.946862] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:44.702Z","message":"Cleaning working queues"}1290gitlab # [ 145.951493] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:44.707Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"772fc1e29ad8b71fac4d63b9","created_at":"2026-07-12T13:11:42.953Z","trace_propagation_headers":{"sentry-trace":"30664bd2d107402cb2bd1998f39446f1-08e712b071dc4083","baggage":"sentry-trace_id=30664bd2d107402cb2bd1998f39446f1,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"6d738259ede4f3ad1ee13e9178bc4fda","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-12T13:11:42.967Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-772fc1e29ad8b71fac4d63b9: start","job_status":"start","queue_duration_s":61.739717,"scheduling_latency_s":61.739827}1291gitlab # [ 146.156420] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:12:44.911Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"772fc1e29ad8b71fac4d63b9","created_at":"2026-07-12T13:11:42.953Z","trace_propagation_headers":{"sentry-trace":"30664bd2d107402cb2bd1998f39446f1-08e712b071dc4083","baggage":"sentry-trace_id=30664bd2d107402cb2bd1998f39446f1,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"6d738259ede4f3ad1ee13e9178bc4fda","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-12T13:11:42.967Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-772fc1e29ad8b71fac4d63b9: done: 0.205002 sec","job_status":"done","queue_duration_s":61.739717,"scheduling_latency_s":61.739827,"redis_calls":26,"redis_duration_s":0.009838,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.004929,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003016,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001893,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.098797752,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.205002,"completed_at":"2026-07-12T13:12:44.911Z","load_balancing_strategy":"primary","db_duration_s":0.060499,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1292gitlab # [ 146.411421] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:12:45 +0000] "PUT /api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true HTTP/1.1" 200 17133 "" "curl/8.20.0" 8621293gitlab # [ 146.421821] setup-gitlab-start[2701]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner Rails.cache.clear1294gitlab # [ 146.438145] runuser[2753]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1295gitlab # [ 146.796936] setup-gitlab-start[2754]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1296gitlab # [ 146.800413] setup-gitlab-start[2754]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1297gitlab # [ 146.803204] setup-gitlab-start[2754]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1298gitlab # [ 147.411316] setup-gitlab-start[2754]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1299gitlab # [ 147.414827] setup-gitlab-start[2754]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1300gitlab # [ 147.416749] setup-gitlab-start[2754]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1301gitlab # [ 165.255830] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:04.010Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b795edc552fc03f7bf67db91","created_at":"2026-07-12T13:13:03.967Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81f4c52d0e95f7c517c4dea46e68622e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.007Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b795edc552fc03f7bf67db91: start","job_status":"start","queue_duration_s":0.003431,"scheduling_latency_s":0.003483}1302gitlab # [ 165.385571] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:04.140Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b795edc552fc03f7bf67db91","created_at":"2026-07-12T13:13:03.967Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81f4c52d0e95f7c517c4dea46e68622e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.007Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b795edc552fc03f7bf67db91: done: 0.13015 sec","job_status":"done","queue_duration_s":0.003431,"scheduling_latency_s":0.003483,"redis_calls":12,"redis_duration_s":0.024763999999999998,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004604,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015776,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004384,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003478375,"duration_s":0.13015,"completed_at":"2026-07-12T13:13:04.140Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004423,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 165.391936] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:04.148Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"42702ff4b5ad738c77de2387","created_at":"2026-07-12T13:13:04.067Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e737d242800f5167d5b9bf0acff30258","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.096Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-42702ff4b5ad738c77de2387: start","job_status":"start","queue_duration_s":0.051481,"scheduling_latency_s":0.051539}1304gitlab # [ 165.427282] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:04.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"42702ff4b5ad738c77de2387","created_at":"2026-07-12T13:13:04.067Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e737d242800f5167d5b9bf0acff30258","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.096Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-42702ff4b5ad738c77de2387: done: 0.035532 sec","job_status":"done","queue_duration_s":0.051481,"scheduling_latency_s":0.051539,"redis_calls":12,"redis_duration_s":0.004153,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000531,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002227,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001395,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000603428,"exclusive_lock_hold_duration_s":0.007698464,"duration_s":0.035532,"completed_at":"2026-07-12T13:13:04.183Z","load_balancing_strategy":"primary","db_duration_s":0.005365,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 165.560794] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:04.316Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"383384d14155e55931338e95","created_at":"2026-07-12T13:13:04.117Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec0c4efd4320bda0aa449410be5a24f4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.313Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-383384d14155e55931338e95: start","job_status":"start","queue_duration_s":0.003262,"scheduling_latency_s":0.003331}1306gitlab # [ 166.174266] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:04.930Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"383384d14155e55931338e95","created_at":"2026-07-12T13:13:04.117Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec0c4efd4320bda0aa449410be5a24f4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.313Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-383384d14155e55931338e95: done: 0.613734 sec","job_status":"done","queue_duration_s":0.003262,"scheduling_latency_s":0.003331,"redis_calls":12,"redis_duration_s":0.014371,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002073,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0055,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.262781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.003122464,"exclusive_lock_hold_duration_s":0.44631510399999996,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.613734,"completed_at":"2026-07-12T13:13:04.930Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.09296,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 166.245673] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.001Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1b26189dd6c4c10bed127a2d","created_at":"2026-07-12T13:13:04.348Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e44408cc46f9236c5d8dd8bc9071ee5c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.370Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1b26189dd6c4c10bed127a2d: start","job_status":"start","queue_duration_s":0.631219,"scheduling_latency_s":0.631261}1308gitlab # [ 166.293732] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.049Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1309gitlab # [ 166.314879] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.070Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1b26189dd6c4c10bed127a2d","created_at":"2026-07-12T13:13:04.348Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e44408cc46f9236c5d8dd8bc9071ee5c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.370Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1b26189dd6c4c10bed127a2d: done: 0.069065 sec","job_status":"done","queue_duration_s":0.631219,"scheduling_latency_s":0.631261,"redis_calls":10,"redis_duration_s":0.009931,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001209,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007837,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000790044,"duration_s":0.069065,"completed_at":"2026-07-12T13:13:05.070Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 166.352362] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.075Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"19b3d03169e93fc4db656cc3","created_at":"2026-07-12T13:13:04.448Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8457ea62af37ee20583bc2c74b0ced38","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.458Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-19b3d03169e93fc4db656cc3: start","job_status":"start","queue_duration_s":0.616555,"scheduling_latency_s":0.616636}1311gitlab # [ 166.431927] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.187Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"19b3d03169e93fc4db656cc3","created_at":"2026-07-12T13:13:04.448Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8457ea62af37ee20583bc2c74b0ced38","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.458Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-19b3d03169e93fc4db656cc3: done: 0.111608 sec","job_status":"done","queue_duration_s":0.616555,"scheduling_latency_s":0.616636,"redis_calls":12,"redis_duration_s":0.007975,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001163,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003932,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00288,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001445714,"exclusive_lock_hold_duration_s":0.063275361,"duration_s":0.111608,"completed_at":"2026-07-12T13:13:05.186Z","load_balancing_strategy":"primary","db_duration_s":0.056448,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 166.500233] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.256Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"311974a760b5393632a055af","created_at":"2026-07-12T13:13:04.469Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21ebc935a1c38d475684f1091a805f3c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-12T13:13:04.503Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-311974a760b5393632a055af: start","job_status":"start","queue_duration_s":0.752286,"scheduling_latency_s":0.75236}1313gitlab # [ 166.569776] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.325Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"311974a760b5393632a055af","created_at":"2026-07-12T13:13:04.469Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21ebc935a1c38d475684f1091a805f3c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-12T13:13:04.503Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-311974a760b5393632a055af: done: 0.069779 sec","job_status":"done","queue_duration_s":0.752286,"scheduling_latency_s":0.75236,"redis_calls":10,"redis_duration_s":0.007032,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001563,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004069,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0014,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001007112,"duration_s":0.069779,"completed_at":"2026-07-12T13:13:05.325Z","load_balancing_strategy":"primary","db_duration_s":0.007255,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 166.577321] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.331Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"46ce74dcb2bd4be332c23a69","created_at":"2026-07-12T13:13:04.524Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d32a0a0c3135d42e84deaaa6acd833d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.539Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-46ce74dcb2bd4be332c23a69: start","job_status":"start","queue_duration_s":0.792391,"scheduling_latency_s":0.792436}1315gitlab # [ 166.928486] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.684Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"46ce74dcb2bd4be332c23a69","created_at":"2026-07-12T13:13:04.524Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d32a0a0c3135d42e84deaaa6acd833d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.539Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-46ce74dcb2bd4be332c23a69: done: 0.353007 sec","job_status":"done","queue_duration_s":0.792391,"scheduling_latency_s":0.792436,"redis_calls":14,"redis_duration_s":0.008753,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002599,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003376,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002778,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":125,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":125,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.059,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":123,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":80,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.057,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.180612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001413028,"exclusive_lock_hold_duration_s":0.228824612,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.353007,"completed_at":"2026-07-12T13:13:05.684Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.093145,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 167.041453] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.797Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8992404a6c3689d7b4822248","created_at":"2026-07-12T13:13:04.558Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d90adbd3020986b413471cb86036cce5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.573Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8992404a6c3689d7b4822248: start","job_status":"start","queue_duration_s":1.223588,"scheduling_latency_s":1.223654}1317gitlab # [ 167.085485] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.841Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8992404a6c3689d7b4822248","created_at":"2026-07-12T13:13:04.558Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d90adbd3020986b413471cb86036cce5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.573Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8992404a6c3689d7b4822248: done: 0.04452 sec","job_status":"done","queue_duration_s":1.223588,"scheduling_latency_s":1.223654,"redis_calls":13,"redis_duration_s":0.006711,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000917,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002936,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002858,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.009958808,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.04452,"completed_at":"2026-07-12T13:13:05.841Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005153,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1318gitlab # [ 167.122746] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.843Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"5cc5f49f3e4362c2821fd3a4","created_at":"2026-07-12T13:13:04.587Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f76eed97ee3c4d916d670ebaa5aa0921","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.597Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-5cc5f49f3e4362c2821fd3a4: start","job_status":"start","queue_duration_s":1.24646,"scheduling_latency_s":1.246482}1319gitlab # [ 167.124483] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.870Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"5cc5f49f3e4362c2821fd3a4","created_at":"2026-07-12T13:13:04.587Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f76eed97ee3c4d916d670ebaa5aa0921","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.597Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-5cc5f49f3e4362c2821fd3a4: done: 0.026459 sec","job_status":"done","queue_duration_s":1.24646,"scheduling_latency_s":1.246482,"redis_calls":12,"redis_duration_s":0.005248,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000939,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002584,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001725,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000678298,"exclusive_lock_hold_duration_s":0.0060136140000000005,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.026459,"completed_at":"2026-07-12T13:13:05.870Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00413,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 167.219592] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.872Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6c4415c2f0ca2e4247bafe69","created_at":"2026-07-12T13:13:04.611Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"197ae658a866decdf7700fe82a9082af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.617Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6c4415c2f0ca2e4247bafe69: start","job_status":"start","queue_duration_s":1.25506,"scheduling_latency_s":1.255081}1321gitlab # [ 167.220979] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.889Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1322gitlab # [ 167.221798] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.896Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6c4415c2f0ca2e4247bafe69","created_at":"2026-07-12T13:13:04.611Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"197ae658a866decdf7700fe82a9082af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.617Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6c4415c2f0ca2e4247bafe69: done: 0.024191 sec","job_status":"done","queue_duration_s":1.25506,"scheduling_latency_s":1.255081,"redis_calls":10,"redis_duration_s":0.003773,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0005,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001901,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001372,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000363174,"duration_s":0.024191,"completed_at":"2026-07-12T13:13:05.896Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002537,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 167.300617] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.897Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1a50df96b04c16dd1bcd646e","created_at":"2026-07-12T13:13:04.622Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed7882a3d8e96d73401dce575c8c865a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.627Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1a50df96b04c16dd1bcd646e: start","job_status":"start","queue_duration_s":1.270162,"scheduling_latency_s":1.270222}1324gitlab # [ 167.302242] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.916Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1a50df96b04c16dd1bcd646e","created_at":"2026-07-12T13:13:04.622Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed7882a3d8e96d73401dce575c8c865a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.627Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1a50df96b04c16dd1bcd646e: done: 0.018753 sec","job_status":"done","queue_duration_s":1.270162,"scheduling_latency_s":1.270222,"redis_calls":10,"redis_duration_s":0.002291,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00052,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001319,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000452,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000385803,"duration_s":0.018753,"completed_at":"2026-07-12T13:13:05.916Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00136,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 167.375269] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.918Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d9dbbeddc13d094e57f0dc7f","created_at":"2026-07-12T13:13:04.635Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6eddb42624ef521d909cd648631e84c0","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.641Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d9dbbeddc13d094e57f0dc7f: start","job_status":"start","queue_duration_s":1.276903,"scheduling_latency_s":1.276925}1326gitlab # [ 167.444284] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.943Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d9dbbeddc13d094e57f0dc7f","created_at":"2026-07-12T13:13:04.635Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6eddb42624ef521d909cd648631e84c0","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.641Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d9dbbeddc13d094e57f0dc7f: done: 0.025481 sec","job_status":"done","queue_duration_s":1.276903,"scheduling_latency_s":1.276925,"redis_calls":10,"redis_duration_s":0.0024939999999999997,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000463,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001527,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000504,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000348089,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.025481,"completed_at":"2026-07-12T13:13:05.943Z","load_balancing_strategy":"primary","db_duration_s":0.006538,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 167.445868] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.945Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"114e12f3d04be708922b8767","created_at":"2026-07-12T13:13:04.647Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"345dcc00f1d9f7b051ccd8512c19038e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.653Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-114e12f3d04be708922b8767: start","job_status":"start","queue_duration_s":1.291668,"scheduling_latency_s":1.291689}1328gitlab # [ 167.519286] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.965Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"114e12f3d04be708922b8767","created_at":"2026-07-12T13:13:04.647Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"345dcc00f1d9f7b051ccd8512c19038e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.653Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-114e12f3d04be708922b8767: done: 0.020686 sec","job_status":"done","queue_duration_s":1.291668,"scheduling_latency_s":1.291689,"redis_calls":10,"redis_duration_s":0.0024590000000000002,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000476,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001482,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000501,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000503416,"duration_s":0.020686,"completed_at":"2026-07-12T13:13:05.965Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001838,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 167.588953] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.967Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"26b3ca48d889dc68f1e974aa","created_at":"2026-07-12T13:13:04.658Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd1624ba88e4cdb2cceb2960a6a8f679","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-12T13:13:04.665Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-26b3ca48d889dc68f1e974aa: start","job_status":"start","queue_duration_s":1.301822,"scheduling_latency_s":1.301854}1330gitlab # [ 167.590337] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.978Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1331gitlab # [ 167.591454] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.984Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"26b3ca48d889dc68f1e974aa","created_at":"2026-07-12T13:13:04.658Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd1624ba88e4cdb2cceb2960a6a8f679","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-12T13:13:04.665Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-26b3ca48d889dc68f1e974aa: done: 0.01778 sec","job_status":"done","queue_duration_s":1.301822,"scheduling_latency_s":1.301854,"redis_calls":10,"redis_duration_s":0.003242,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00135,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001414,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000478,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000346413,"duration_s":0.01778,"completed_at":"2026-07-12T13:13:05.984Z","load_balancing_strategy":"primary","db_duration_s":0.000479,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 167.660882] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:05.986Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"351a9b7aca34b9bfd71782a7","created_at":"2026-07-12T13:13:04.672Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b3688e30ca9ba023657cf691c79814e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.678Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-351a9b7aca34b9bfd71782a7: start","job_status":"start","queue_duration_s":1.308544,"scheduling_latency_s":1.308565}1333gitlab # [ 167.662179] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.014Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"351a9b7aca34b9bfd71782a7","created_at":"2026-07-12T13:13:04.672Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b3688e30ca9ba023657cf691c79814e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.678Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-351a9b7aca34b9bfd71782a7: done: 0.028268 sec","job_status":"done","queue_duration_s":1.308544,"scheduling_latency_s":1.308565,"redis_calls":16,"redis_duration_s":0.004346,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.00204,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001542,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000764,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038748,"duration_s":0.028268,"completed_at":"2026-07-12T13:13:06.014Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003935,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 167.746945] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.016Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"62df3a74373849e256161424","created_at":"2026-07-12T13:13:04.682Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"54ae2a87a7f4728374e4e7af93f868ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-12T13:13:04.688Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-62df3a74373849e256161424: start","job_status":"start","queue_duration_s":1.32775,"scheduling_latency_s":1.32777}1335gitlab # [ 167.748310] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.027Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1336gitlab # [ 167.749328] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.033Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"62df3a74373849e256161424","created_at":"2026-07-12T13:13:04.682Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"54ae2a87a7f4728374e4e7af93f868ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-12T13:13:04.688Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-62df3a74373849e256161424: done: 0.016998 sec","job_status":"done","queue_duration_s":1.32775,"scheduling_latency_s":1.32777,"redis_calls":10,"redis_duration_s":0.002163,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000424,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001305,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037854,"duration_s":0.016998,"completed_at":"2026-07-12T13:13:06.033Z","load_balancing_strategy":"primary","db_duration_s":0.000415,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 167.840940] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.035Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"229ec3d9ea80d7eb8d552451","created_at":"2026-07-12T13:13:04.710Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.720Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-229ec3d9ea80d7eb8d552451: start","job_status":"start","queue_duration_s":1.314424,"scheduling_latency_s":1.314444}1338gitlab # [ 167.842394] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.140Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"229ec3d9ea80d7eb8d552451","created_at":"2026-07-12T13:13:04.710Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.720Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-229ec3d9ea80d7eb8d552451: done: 0.10489 sec","job_status":"done","queue_duration_s":1.314424,"scheduling_latency_s":1.314444,"redis_calls":71,"redis_duration_s":0.023641,"redis_read_bytes":120,"redis_write_bytes":42524,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.004839,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000763,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37335,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.01732,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000719,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003872,"duration_s":0.10489,"completed_at":"2026-07-12T13:13:06.140Z","load_balancing_strategy":"primary","db_duration_s":0.005127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 167.947900] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.141Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"9387bf1e348e7611fdb53c52","created_at":"2026-07-12T13:13:04.729Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b32ea7f8ec0ce92aadf2d0a0c6fdd096","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.737Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-9387bf1e348e7611fdb53c52: start","job_status":"start","queue_duration_s":1.404794,"scheduling_latency_s":1.404816}1340gitlab # [ 167.949310] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.173Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"9387bf1e348e7611fdb53c52","created_at":"2026-07-12T13:13:04.729Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b32ea7f8ec0ce92aadf2d0a0c6fdd096","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.737Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-9387bf1e348e7611fdb53c52: done: 0.031353 sec","job_status":"done","queue_duration_s":1.404794,"scheduling_latency_s":1.404816,"redis_calls":19,"redis_duration_s":0.004266,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000958,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000289,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002298,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000721,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000354794,"duration_s":0.031353,"completed_at":"2026-07-12T13:13:06.173Z","load_balancing_strategy":"primary","db_duration_s":0.00191,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 168.021741] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.174Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e9a9df04c7c1dec1646c7814","created_at":"2026-07-12T13:13:04.743Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf2ff7933876509cb292c172e95491ba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.750Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e9a9df04c7c1dec1646c7814: start","job_status":"start","queue_duration_s":1.423815,"scheduling_latency_s":1.423878}1342gitlab # [ 168.023302] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.185Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1343gitlab # [ 168.025164] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.192Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e9a9df04c7c1dec1646c7814","created_at":"2026-07-12T13:13:04.743Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf2ff7933876509cb292c172e95491ba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.750Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e9a9df04c7c1dec1646c7814: done: 0.017341 sec","job_status":"done","queue_duration_s":1.423815,"scheduling_latency_s":1.423878,"redis_calls":10,"redis_duration_s":0.002283,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000435,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001357,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000351441,"duration_s":0.017341,"completed_at":"2026-07-12T13:13:06.192Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000526,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 168.070347] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.193Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"e95b93b5c12542e7de4ad403","created_at":"2026-07-12T13:13:04.755Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6eb483c93d6d233fc9f075de8099c1e0","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.762Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-e95b93b5c12542e7de4ad403: start","job_status":"start","queue_duration_s":1.431374,"scheduling_latency_s":1.431395}1345gitlab # [ 168.151675] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.618Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"e95b93b5c12542e7de4ad403","created_at":"2026-07-12T13:13:04.755Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6eb483c93d6d233fc9f075de8099c1e0","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.762Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-e95b93b5c12542e7de4ad403: done: 0.424497 sec","job_status":"done","queue_duration_s":1.431374,"scheduling_latency_s":1.431395,"redis_calls":574,"redis_duration_s":0.139383,"redis_read_bytes":573,"redis_write_bytes":49866,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00115,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005297,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.132936,"redis_shared_state_read_bytes":567,"redis_shared_state_write_bytes":49017,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.327352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003872,"duration_s":0.424497,"completed_at":"2026-07-12T13:13:06.618Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000486,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 168.156159] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.620Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c918e2127a3763cb14481c55","created_at":"2026-07-12T13:13:04.771Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce13950376c6668ce411e241500e25d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.778Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c918e2127a3763cb14481c55: start","job_status":"start","queue_duration_s":1.84155,"scheduling_latency_s":1.841572}1347gitlab # [ 168.224162] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.914Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1348gitlab # [ 168.225277] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.922Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c918e2127a3763cb14481c55","created_at":"2026-07-12T13:13:04.771Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce13950376c6668ce411e241500e25d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.778Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c918e2127a3763cb14481c55: done: 0.302038 sec","job_status":"done","queue_duration_s":1.84155,"scheduling_latency_s":1.841572,"redis_calls":10,"redis_duration_s":0.002518,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000574,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001482,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.282,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.282,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000420724,"duration_s":0.302038,"completed_at":"2026-07-12T13:13:06.922Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.281523,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 168.293549] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.923Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8b69ec9be72f9accebf6629d","created_at":"2026-07-12T13:13:04.783Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"359ae47d1cd01cb1b969f21bc4ece990","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.789Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8b69ec9be72f9accebf6629d: start","job_status":"start","queue_duration_s":2.133942,"scheduling_latency_s":2.133966}1350gitlab # [ 168.295106] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.960Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8b69ec9be72f9accebf6629d","created_at":"2026-07-12T13:13:04.783Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-c461eebfa5ec44ba","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"359ae47d1cd01cb1b969f21bc4ece990","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:04.789Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8b69ec9be72f9accebf6629d: done: 0.036727 sec","job_status":"done","queue_duration_s":2.133942,"scheduling_latency_s":2.133966,"redis_calls":12,"redis_duration_s":0.003148,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000592,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001476,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00108,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000711543,"exclusive_lock_hold_duration_s":0.014537602,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.036727,"completed_at":"2026-07-12T13:13:06.960Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006847,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 168.371874] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c1b0ed17642eb4329f6de52","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c1b0ed17642eb4329f6de52: start","job_status":"start","queue_duration_s":0.833922,"scheduling_latency_s":0.833945}1352gitlab # [ 168.373272] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c1b0ed17642eb4329f6de52","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c1b0ed17642eb4329f6de52: done: 0.022338 sec","job_status":"done","queue_duration_s":0.833922,"scheduling_latency_s":0.833945,"redis_calls":16,"redis_duration_s":0.0038770000000000002,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000448,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001275,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002154,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000381054,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022338,"completed_at":"2026-07-12T13:13:06.984Z","load_balancing_strategy":"primary","db_duration_s":0.00045,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 168.452564] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:06.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eefc7ec5fe6f6f295696832f","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eefc7ec5fe6f6f295696832f: start","job_status":"start","queue_duration_s":0.857758,"scheduling_latency_s":0.85778}1354gitlab # [ 168.454202] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eefc7ec5fe6f6f295696832f","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eefc7ec5fe6f6f295696832f: done: 0.016179 sec","job_status":"done","queue_duration_s":0.857758,"scheduling_latency_s":0.85778,"redis_calls":13,"redis_duration_s":0.003135,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00116,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016179,"completed_at":"2026-07-12T13:13:07.001Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 168.534459] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2aaf93e10d5e098de119b050","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2aaf93e10d5e098de119b050: start","job_status":"start","queue_duration_s":0.875978,"scheduling_latency_s":0.876025}1356gitlab # [ 168.535198] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2aaf93e10d5e098de119b050","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2aaf93e10d5e098de119b050: done: 0.087195 sec","job_status":"done","queue_duration_s":0.875978,"scheduling_latency_s":0.876025,"redis_calls":13,"redis_duration_s":0.003248,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.087195,"completed_at":"2026-07-12T13:13:07.091Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 168.608809] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d90f9ac8672111fa7166354","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d90f9ac8672111fa7166354: start","job_status":"start","queue_duration_s":0.964652,"scheduling_latency_s":0.96468}1358gitlab # [ 168.610140] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d90f9ac8672111fa7166354","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d90f9ac8672111fa7166354: done: 0.016348 sec","job_status":"done","queue_duration_s":0.964652,"scheduling_latency_s":0.96468,"redis_calls":13,"redis_duration_s":0.0033049999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001246,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016348,"completed_at":"2026-07-12T13:13:07.109Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 168.681392] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7825041fd5d19bcdf8ad951","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7825041fd5d19bcdf8ad951: start","job_status":"start","queue_duration_s":0.982316,"scheduling_latency_s":0.982337}1360gitlab # [ 168.682953] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7825041fd5d19bcdf8ad951","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7825041fd5d19bcdf8ad951: done: 0.015167 sec","job_status":"done","queue_duration_s":0.982316,"scheduling_latency_s":0.982337,"redis_calls":13,"redis_duration_s":0.002895,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015167,"completed_at":"2026-07-12T13:13:07.125Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 168.753935] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec6c774aef22246bf584a499","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec6c774aef22246bf584a499: start","job_status":"start","queue_duration_s":0.998848,"scheduling_latency_s":0.998869}1362gitlab # [ 168.755361] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec6c774aef22246bf584a499","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec6c774aef22246bf584a499: done: 0.015424 sec","job_status":"done","queue_duration_s":0.998848,"scheduling_latency_s":0.998869,"redis_calls":13,"redis_duration_s":0.0029679999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015424,"completed_at":"2026-07-12T13:13:07.142Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 168.825270] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12f8c076812b07f8fcd6514a","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12f8c076812b07f8fcd6514a: start","job_status":"start","queue_duration_s":1.01602,"scheduling_latency_s":1.016041}1364gitlab # [ 168.834539] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12f8c076812b07f8fcd6514a","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12f8c076812b07f8fcd6514a: done: 0.015242 sec","job_status":"done","queue_duration_s":1.01602,"scheduling_latency_s":1.016041,"redis_calls":13,"redis_duration_s":0.002986,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00202,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015242,"completed_at":"2026-07-12T13:13:07.159Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 168.906609] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb37bcb1400da24f2114ad96","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb37bcb1400da24f2114ad96: start","job_status":"start","queue_duration_s":1.032533,"scheduling_latency_s":1.032555}1366gitlab # [ 168.914131] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb37bcb1400da24f2114ad96","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb37bcb1400da24f2114ad96: done: 0.015346 sec","job_status":"done","queue_duration_s":1.032533,"scheduling_latency_s":1.032555,"redis_calls":13,"redis_duration_s":0.002848,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015346,"completed_at":"2026-07-12T13:13:07.175Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 169.005513] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37e1c684a9bef50572b52e80","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37e1c684a9bef50572b52e80: start","job_status":"start","queue_duration_s":1.049179,"scheduling_latency_s":1.049202}1368gitlab # [ 169.007596] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37e1c684a9bef50572b52e80","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37e1c684a9bef50572b52e80: done: 0.015253 sec","job_status":"done","queue_duration_s":1.049179,"scheduling_latency_s":1.049202,"redis_calls":13,"redis_duration_s":0.0028409999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015253,"completed_at":"2026-07-12T13:13:07.192Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 169.058214] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20ff570368bee843f0f7ed36","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20ff570368bee843f0f7ed36: start","job_status":"start","queue_duration_s":1.065706,"scheduling_latency_s":1.06577}1370gitlab # [ 169.126753] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20ff570368bee843f0f7ed36","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20ff570368bee843f0f7ed36: done: 0.015507 sec","job_status":"done","queue_duration_s":1.065706,"scheduling_latency_s":1.06577,"redis_calls":13,"redis_duration_s":0.003224,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001179,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009838,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015507,"completed_at":"2026-07-12T13:13:07.209Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 169.138466] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb35c4d22e177c769ad6dd53","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb35c4d22e177c769ad6dd53: start","job_status":"start","queue_duration_s":1.082974,"scheduling_latency_s":1.082995}1372gitlab # [ 169.160104] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb35c4d22e177c769ad6dd53","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb35c4d22e177c769ad6dd53: done: 0.015324 sec","job_status":"done","queue_duration_s":1.082974,"scheduling_latency_s":1.082995,"redis_calls":13,"redis_duration_s":0.003379,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001316,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015324,"completed_at":"2026-07-12T13:13:07.226Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 169.248224] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22ae05eb94fb24eecafb8de6","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22ae05eb94fb24eecafb8de6: start","job_status":"start","queue_duration_s":1.099622,"scheduling_latency_s":1.099643}1374gitlab # [ 169.249839] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22ae05eb94fb24eecafb8de6","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22ae05eb94fb24eecafb8de6: done: 0.015285 sec","job_status":"done","queue_duration_s":1.099622,"scheduling_latency_s":1.099643,"redis_calls":13,"redis_duration_s":0.002994,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015285,"completed_at":"2026-07-12T13:13:07.242Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 169.342141] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.244Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa633c89af7976f43b902301","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa633c89af7976f43b902301: start","job_status":"start","queue_duration_s":1.116203,"scheduling_latency_s":1.116224}1376gitlab # [ 169.343266] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa633c89af7976f43b902301","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa633c89af7976f43b902301: done: 0.015195 sec","job_status":"done","queue_duration_s":1.116203,"scheduling_latency_s":1.116224,"redis_calls":13,"redis_duration_s":0.0028770000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000871,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015195,"completed_at":"2026-07-12T13:13:07.259Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 169.416654] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc82fd983f40e9c7caa31f3d","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc82fd983f40e9c7caa31f3d: start","job_status":"start","queue_duration_s":1.13276,"scheduling_latency_s":1.132783}1378gitlab # [ 169.417914] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc82fd983f40e9c7caa31f3d","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc82fd983f40e9c7caa31f3d: done: 0.015361 sec","job_status":"done","queue_duration_s":1.13276,"scheduling_latency_s":1.132783,"redis_calls":13,"redis_duration_s":0.003065,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015361,"completed_at":"2026-07-12T13:13:07.276Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 169.489113] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ee8ae36420d48e3c653145c","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ee8ae36420d48e3c653145c: start","job_status":"start","queue_duration_s":1.149885,"scheduling_latency_s":1.149905}1380gitlab # [ 169.490190] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ee8ae36420d48e3c653145c","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ee8ae36420d48e3c653145c: done: 0.015639 sec","job_status":"done","queue_duration_s":1.149885,"scheduling_latency_s":1.149905,"redis_calls":13,"redis_duration_s":0.0030180000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002047,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015639,"completed_at":"2026-07-12T13:13:07.293Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 169.566232] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"713bed47fefbd1e556d4c049","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-713bed47fefbd1e556d4c049: start","job_status":"start","queue_duration_s":1.166889,"scheduling_latency_s":1.16691}1382gitlab # [ 169.567880] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"713bed47fefbd1e556d4c049","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-713bed47fefbd1e556d4c049: done: 0.019351 sec","job_status":"done","queue_duration_s":1.166889,"scheduling_latency_s":1.16691,"redis_calls":13,"redis_duration_s":0.003348,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001189,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002159,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019351,"completed_at":"2026-07-12T13:13:07.314Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 169.635061] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bb3f06674ac3381d7bddf5f","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bb3f06674ac3381d7bddf5f: start","job_status":"start","queue_duration_s":1.187843,"scheduling_latency_s":1.187875}1384gitlab # [ 169.636249] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bb3f06674ac3381d7bddf5f","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bb3f06674ac3381d7bddf5f: done: 0.016041 sec","job_status":"done","queue_duration_s":1.187843,"scheduling_latency_s":1.187875,"redis_calls":13,"redis_duration_s":0.002915,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016041,"completed_at":"2026-07-12T13:13:07.331Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 169.711067] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7216cd7a7834417143dc9dc9","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7216cd7a7834417143dc9dc9: start","job_status":"start","queue_duration_s":1.205988,"scheduling_latency_s":1.206011}1386gitlab # [ 169.712375] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7216cd7a7834417143dc9dc9","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7216cd7a7834417143dc9dc9: done: 0.015267 sec","job_status":"done","queue_duration_s":1.205988,"scheduling_latency_s":1.206011,"redis_calls":13,"redis_duration_s":0.002834,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015267,"completed_at":"2026-07-12T13:13:07.349Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 169.781319] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c230119a5a36312db098b572","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c230119a5a36312db098b572: start","job_status":"start","queue_duration_s":1.222542,"scheduling_latency_s":1.222563}1388gitlab # [ 169.850609] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c230119a5a36312db098b572","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c230119a5a36312db098b572: done: 0.018482 sec","job_status":"done","queue_duration_s":1.222542,"scheduling_latency_s":1.222563,"redis_calls":13,"redis_duration_s":0.003232,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001042,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00219,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018482,"completed_at":"2026-07-12T13:13:07.369Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 169.852870] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce21687245608c690b5409b4","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce21687245608c690b5409b4: start","job_status":"start","queue_duration_s":1.242771,"scheduling_latency_s":1.242803}1390gitlab # [ 169.933052] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce21687245608c690b5409b4","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce21687245608c690b5409b4: done: 0.017588 sec","job_status":"done","queue_duration_s":1.242771,"scheduling_latency_s":1.242803,"redis_calls":13,"redis_duration_s":0.003177,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002261,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017588,"completed_at":"2026-07-12T13:13:07.388Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 169.935043] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0d7a7dc2d0043b3c7ac0ed2","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0d7a7dc2d0043b3c7ac0ed2: start","job_status":"start","queue_duration_s":1.261605,"scheduling_latency_s":1.261626}1392gitlab # [ 170.009603] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0d7a7dc2d0043b3c7ac0ed2","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0d7a7dc2d0043b3c7ac0ed2: done: 0.015939 sec","job_status":"done","queue_duration_s":1.261605,"scheduling_latency_s":1.261626,"redis_calls":13,"redis_duration_s":0.0031790000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000969,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00221,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015939,"completed_at":"2026-07-12T13:13:07.405Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 170.011590] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f74c63f7a399494cd58985e1","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f74c63f7a399494cd58985e1: start","job_status":"start","queue_duration_s":1.278885,"scheduling_latency_s":1.278907}1394gitlab # [ 170.032352] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f74c63f7a399494cd58985e1","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f74c63f7a399494cd58985e1: done: 0.01565 sec","job_status":"done","queue_duration_s":1.278885,"scheduling_latency_s":1.278907,"redis_calls":13,"redis_duration_s":0.0028580000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01565,"completed_at":"2026-07-12T13:13:07.422Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 170.109331] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc09e746041cd5282cd50bc9","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc09e746041cd5282cd50bc9: start","job_status":"start","queue_duration_s":1.296292,"scheduling_latency_s":1.296314}1396gitlab # [ 170.110735] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc09e746041cd5282cd50bc9","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc09e746041cd5282cd50bc9: done: 0.015725 sec","job_status":"done","queue_duration_s":1.296292,"scheduling_latency_s":1.296314,"redis_calls":13,"redis_duration_s":0.003146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001045,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015725,"completed_at":"2026-07-12T13:13:07.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 170.210305] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7587f460a74f837de17512e7","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7587f460a74f837de17512e7: start","job_status":"start","queue_duration_s":1.313337,"scheduling_latency_s":1.313359}1398gitlab # [ 170.213150] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7587f460a74f837de17512e7","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7587f460a74f837de17512e7: done: 0.015569 sec","job_status":"done","queue_duration_s":1.313337,"scheduling_latency_s":1.313359,"redis_calls":13,"redis_duration_s":0.00295,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015569,"completed_at":"2026-07-12T13:13:07.456Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 170.298402] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5747b30141bbbd91d7a1c896","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5747b30141bbbd91d7a1c896: start","job_status":"start","queue_duration_s":1.330194,"scheduling_latency_s":1.330215}1400gitlab # [ 170.299976] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5747b30141bbbd91d7a1c896","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5747b30141bbbd91d7a1c896: done: 0.015426 sec","job_status":"done","queue_duration_s":1.330194,"scheduling_latency_s":1.330215,"redis_calls":13,"redis_duration_s":0.002928,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015426,"completed_at":"2026-07-12T13:13:07.473Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 170.370558] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.475Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cf6e8b832de5aa4a7db37d7","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cf6e8b832de5aa4a7db37d7: start","job_status":"start","queue_duration_s":1.346956,"scheduling_latency_s":1.346978}1402gitlab # [ 170.371897] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cf6e8b832de5aa4a7db37d7","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cf6e8b832de5aa4a7db37d7: done: 0.015971 sec","job_status":"done","queue_duration_s":1.346956,"scheduling_latency_s":1.346978,"redis_calls":13,"redis_duration_s":0.0029,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015971,"completed_at":"2026-07-12T13:13:07.490Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 170.445236] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d166e5c55a2f0a412ea8c03","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d166e5c55a2f0a412ea8c03: start","job_status":"start","queue_duration_s":1.364217,"scheduling_latency_s":1.364238}1404gitlab # [ 170.446561] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d166e5c55a2f0a412ea8c03","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d166e5c55a2f0a412ea8c03: done: 0.015708 sec","job_status":"done","queue_duration_s":1.364217,"scheduling_latency_s":1.364238,"redis_calls":13,"redis_duration_s":0.00321,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001038,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015708,"completed_at":"2026-07-12T13:13:07.507Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 170.527591] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69849abca0d31fd42ec866bf","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69849abca0d31fd42ec866bf: start","job_status":"start","queue_duration_s":1.381269,"scheduling_latency_s":1.381292}1406gitlab # [ 170.529400] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69849abca0d31fd42ec866bf","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69849abca0d31fd42ec866bf: done: 0.015562 sec","job_status":"done","queue_duration_s":1.381269,"scheduling_latency_s":1.381292,"redis_calls":13,"redis_duration_s":0.002967,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015562,"completed_at":"2026-07-12T13:13:07.524Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 170.617248] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89d9293c4fbedcbc0177036f","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89d9293c4fbedcbc0177036f: start","job_status":"start","queue_duration_s":1.398135,"scheduling_latency_s":1.398165}1408gitlab # [ 170.618633] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89d9293c4fbedcbc0177036f","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89d9293c4fbedcbc0177036f: done: 0.015335 sec","job_status":"done","queue_duration_s":1.398135,"scheduling_latency_s":1.398165,"redis_calls":13,"redis_duration_s":0.002895,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015335,"completed_at":"2026-07-12T13:13:07.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 170.692388] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9f6f89e9c481510ab07f636","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9f6f89e9c481510ab07f636: start","job_status":"start","queue_duration_s":1.415326,"scheduling_latency_s":1.415347}1410gitlab # [ 170.693953] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9f6f89e9c481510ab07f636","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9f6f89e9c481510ab07f636: done: 0.015223 sec","job_status":"done","queue_duration_s":1.415326,"scheduling_latency_s":1.415347,"redis_calls":13,"redis_duration_s":0.002941,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015223,"completed_at":"2026-07-12T13:13:07.558Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 170.766567] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e44f224874d8bcca265ae3f","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e44f224874d8bcca265ae3f: start","job_status":"start","queue_duration_s":1.431891,"scheduling_latency_s":1.431913}1412gitlab # [ 170.768372] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e44f224874d8bcca265ae3f","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e44f224874d8bcca265ae3f: done: 0.015542 sec","job_status":"done","queue_duration_s":1.431891,"scheduling_latency_s":1.431913,"redis_calls":13,"redis_duration_s":0.002958,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000892,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015542,"completed_at":"2026-07-12T13:13:07.575Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 170.846255] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4576e3371d4c89ff1cd94814","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4576e3371d4c89ff1cd94814: start","job_status":"start","queue_duration_s":1.44879,"scheduling_latency_s":1.448812}1414gitlab # [ 170.847775] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4576e3371d4c89ff1cd94814","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4576e3371d4c89ff1cd94814: done: 0.015861 sec","job_status":"done","queue_duration_s":1.44879,"scheduling_latency_s":1.448812,"redis_calls":13,"redis_duration_s":0.003407,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001071,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002336,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015861,"completed_at":"2026-07-12T13:13:07.592Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 170.936550] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5becf1c40c408266b55844d6","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5becf1c40c408266b55844d6: start","job_status":"start","queue_duration_s":1.466465,"scheduling_latency_s":1.466487}1416gitlab # [ 170.937962] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5becf1c40c408266b55844d6","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5becf1c40c408266b55844d6: done: 0.133583 sec","job_status":"done","queue_duration_s":1.466465,"scheduling_latency_s":1.466487,"redis_calls":13,"redis_duration_s":0.004195,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001778,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002417,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.133583,"completed_at":"2026-07-12T13:13:07.728Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 171.008593] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"925b247b3300aa1f43e64dd4","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-925b247b3300aa1f43e64dd4: start","job_status":"start","queue_duration_s":1.603984,"scheduling_latency_s":1.604045}1418gitlab # [ 171.010358] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"925b247b3300aa1f43e64dd4","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-925b247b3300aa1f43e64dd4: done: 0.037515 sec","job_status":"done","queue_duration_s":1.603984,"scheduling_latency_s":1.604045,"redis_calls":13,"redis_duration_s":0.006984000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002148,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004836,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037515,"completed_at":"2026-07-12T13:13:07.769Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 171.080574] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.771Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9680c57f11193fe0c8cae72b","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9680c57f11193fe0c8cae72b: start","job_status":"start","queue_duration_s":1.642948,"scheduling_latency_s":1.642974}1420gitlab # [ 171.082488] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9680c57f11193fe0c8cae72b","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9680c57f11193fe0c8cae72b: done: 0.015611 sec","job_status":"done","queue_duration_s":1.642948,"scheduling_latency_s":1.642974,"redis_calls":13,"redis_duration_s":0.003049,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015611,"completed_at":"2026-07-12T13:13:07.786Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 171.130220] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.788Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2da8f1176f5055cc136b1842","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2da8f1176f5055cc136b1842: start","job_status":"start","queue_duration_s":1.660368,"scheduling_latency_s":1.66039}1422gitlab # [ 171.198897] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.803Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2da8f1176f5055cc136b1842","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2da8f1176f5055cc136b1842: done: 0.015252 sec","job_status":"done","queue_duration_s":1.660368,"scheduling_latency_s":1.66039,"redis_calls":13,"redis_duration_s":0.00294,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015252,"completed_at":"2026-07-12T13:13:07.803Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 171.210391] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bfaaa019d61610e1e57bac7","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bfaaa019d61610e1e57bac7: start","job_status":"start","queue_duration_s":1.677201,"scheduling_latency_s":1.677222}1424gitlab # [ 171.231563] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bfaaa019d61610e1e57bac7","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bfaaa019d61610e1e57bac7: done: 0.015415 sec","job_status":"done","queue_duration_s":1.677201,"scheduling_latency_s":1.677222,"redis_calls":13,"redis_duration_s":0.003002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000974,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015415,"completed_at":"2026-07-12T13:13:07.820Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 171.310218] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20df3dae6ae5739f1aeac3d5","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20df3dae6ae5739f1aeac3d5: start","job_status":"start","queue_duration_s":1.693999,"scheduling_latency_s":1.694021}1426gitlab # [ 171.311760] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20df3dae6ae5739f1aeac3d5","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20df3dae6ae5739f1aeac3d5: done: 0.015255 sec","job_status":"done","queue_duration_s":1.693999,"scheduling_latency_s":1.694021,"redis_calls":13,"redis_duration_s":0.002973,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00205,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015255,"completed_at":"2026-07-12T13:13:07.837Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 171.388332] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40f3232e643db9a82daa2ab6","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40f3232e643db9a82daa2ab6: start","job_status":"start","queue_duration_s":1.71111,"scheduling_latency_s":1.711132}1428gitlab # [ 171.389925] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40f3232e643db9a82daa2ab6","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40f3232e643db9a82daa2ab6: done: 0.01537 sec","job_status":"done","queue_duration_s":1.71111,"scheduling_latency_s":1.711132,"redis_calls":13,"redis_duration_s":0.0029920000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000968,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01537,"completed_at":"2026-07-12T13:13:07.854Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 171.458643] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c5885d6a88c0c5bb4dd44a5","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c5885d6a88c0c5bb4dd44a5: start","job_status":"start","queue_duration_s":1.727818,"scheduling_latency_s":1.72784}1430gitlab # [ 171.468951] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c5885d6a88c0c5bb4dd44a5","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c5885d6a88c0c5bb4dd44a5: done: 0.017829 sec","job_status":"done","queue_duration_s":1.727818,"scheduling_latency_s":1.72784,"redis_calls":13,"redis_duration_s":0.005486,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017829,"completed_at":"2026-07-12T13:13:07.873Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 171.540306] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3fe83c63ac12a83bc0f7e21","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3fe83c63ac12a83bc0f7e21: start","job_status":"start","queue_duration_s":1.747672,"scheduling_latency_s":1.747694}1432gitlab # [ 171.547806] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3fe83c63ac12a83bc0f7e21","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3fe83c63ac12a83bc0f7e21: done: 0.01606 sec","job_status":"done","queue_duration_s":1.747672,"scheduling_latency_s":1.747694,"redis_calls":13,"redis_duration_s":0.003429,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001144,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002285,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01606,"completed_at":"2026-07-12T13:13:07.891Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 171.619970] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4434997df89cb77b57eb8aa","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4434997df89cb77b57eb8aa: start","job_status":"start","queue_duration_s":1.76521,"scheduling_latency_s":1.765232}1434gitlab # [ 171.690547] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4434997df89cb77b57eb8aa","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4434997df89cb77b57eb8aa: done: 0.017243 sec","job_status":"done","queue_duration_s":1.76521,"scheduling_latency_s":1.765232,"redis_calls":13,"redis_duration_s":0.004566000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003546,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017243,"completed_at":"2026-07-12T13:13:07.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 171.692340] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c116eb9f482e519969ec3d21","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c116eb9f482e519969ec3d21: start","job_status":"start","queue_duration_s":1.784354,"scheduling_latency_s":1.784376}1436gitlab # [ 171.707441] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c116eb9f482e519969ec3d21","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c116eb9f482e519969ec3d21: done: 0.015566 sec","job_status":"done","queue_duration_s":1.784354,"scheduling_latency_s":1.784376,"redis_calls":13,"redis_duration_s":0.003055,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015566,"completed_at":"2026-07-12T13:13:07.927Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 171.791621] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02131ab37c005bae235fff30","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02131ab37c005bae235fff30: start","job_status":"start","queue_duration_s":1.801226,"scheduling_latency_s":1.801249}1438gitlab # [ 171.793492] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02131ab37c005bae235fff30","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02131ab37c005bae235fff30: done: 0.015506 sec","job_status":"done","queue_duration_s":1.801226,"scheduling_latency_s":1.801249,"redis_calls":13,"redis_duration_s":0.0029,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015506,"completed_at":"2026-07-12T13:13:07.944Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 171.868225] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.946Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17dbe171506d1c24da4893c0","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17dbe171506d1c24da4893c0: start","job_status":"start","queue_duration_s":1.818191,"scheduling_latency_s":1.818213}1440gitlab # [ 171.869656] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17dbe171506d1c24da4893c0","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17dbe171506d1c24da4893c0: done: 0.015314 sec","job_status":"done","queue_duration_s":1.818191,"scheduling_latency_s":1.818213,"redis_calls":13,"redis_duration_s":0.002999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002071,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015314,"completed_at":"2026-07-12T13:13:07.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 171.940203] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.963Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4cd74b472f1e0350561cd76","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4cd74b472f1e0350561cd76: start","job_status":"start","queue_duration_s":1.835084,"scheduling_latency_s":1.835106}1442gitlab # [ 171.946299] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4cd74b472f1e0350561cd76","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4cd74b472f1e0350561cd76: done: 0.015364 sec","job_status":"done","queue_duration_s":1.835084,"scheduling_latency_s":1.835106,"redis_calls":13,"redis_duration_s":0.002979,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015364,"completed_at":"2026-07-12T13:13:07.978Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 172.021274] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc759f4f57aaa7821e12cd16","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc759f4f57aaa7821e12cd16: start","job_status":"start","queue_duration_s":1.852213,"scheduling_latency_s":1.852236}1444gitlab # [ 172.090584] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.995Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc759f4f57aaa7821e12cd16","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc759f4f57aaa7821e12cd16: done: 0.015296 sec","job_status":"done","queue_duration_s":1.852213,"scheduling_latency_s":1.852236,"redis_calls":13,"redis_duration_s":0.0030740000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015296,"completed_at":"2026-07-12T13:13:07.995Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 172.093094] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:07.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4383094b016d705cf50097a","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4383094b016d705cf50097a: start","job_status":"start","queue_duration_s":1.868894,"scheduling_latency_s":1.868916}1446gitlab # [ 172.106509] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:08.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4383094b016d705cf50097a","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4383094b016d705cf50097a: done: 0.015782 sec","job_status":"done","queue_duration_s":1.868894,"scheduling_latency_s":1.868916,"redis_calls":13,"redis_duration_s":0.003616,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002264,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015782,"completed_at":"2026-07-12T13:13:08.012Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 172.182374] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:08.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c0613575693cc50e99c3387","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c0613575693cc50e99c3387: start","job_status":"start","queue_duration_s":1.886044,"scheduling_latency_s":1.886066}1448gitlab # [ 172.186928] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:08.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c0613575693cc50e99c3387","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c0613575693cc50e99c3387: done: 0.015554 sec","job_status":"done","queue_duration_s":1.886044,"scheduling_latency_s":1.886066,"redis_calls":13,"redis_duration_s":0.003032,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00209,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015554,"completed_at":"2026-07-12T13:13:08.029Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 172.262321] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:08.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c52a049e6e01f8ba7461fc17","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c52a049e6e01f8ba7461fc17: start","job_status":"start","queue_duration_s":1.90358,"scheduling_latency_s":1.903602}1450gitlab # [ 172.266653] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:08.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c52a049e6e01f8ba7461fc17","created_at":"2026-07-12T13:13:06.053Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-2ea292bb1c744eee","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"743531e35b4d87a74b7117158eb43974","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.128Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c52a049e6e01f8ba7461fc17: done: 0.015511 sec","job_status":"done","queue_duration_s":1.90358,"scheduling_latency_s":1.903602,"redis_calls":13,"redis_duration_s":0.002886,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015511,"completed_at":"2026-07-12T13:13:08.047Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 172.335335] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:08.048Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e29f214622d7d706aac488ea","created_at":"2026-07-12T13:13:06.157Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-e91319b8f6224ca8","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b32ea7f8ec0ce92aadf2d0a0c6fdd096","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.166Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e29f214622d7d706aac488ea: start","job_status":"start","queue_duration_s":1.881707,"scheduling_latency_s":1.881728}1452gitlab # [ 172.407363] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:08.063Z","message":"No existing merge request to be cleaned up."}1453gitlab # [ 172.409142] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:08.074Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e29f214622d7d706aac488ea","created_at":"2026-07-12T13:13:06.157Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-e91319b8f6224ca8","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b32ea7f8ec0ce92aadf2d0a0c6fdd096","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.166Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e29f214622d7d706aac488ea: done: 0.025847 sec","job_status":"done","queue_duration_s":1.881707,"scheduling_latency_s":1.881728,"redis_calls":13,"redis_duration_s":0.003536,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000547,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001162,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001827,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000367085,"duration_s":0.025847,"completed_at":"2026-07-12T13:13:08.074Z","load_balancing_strategy":"primary","db_duration_s":0.003457,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 172.411257] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:08.075Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"351870bb4a0568a51dac1294","created_at":"2026-07-12T13:13:06.157Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-e91319b8f6224ca8","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b32ea7f8ec0ce92aadf2d0a0c6fdd096","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.166Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-351870bb4a0568a51dac1294: start","job_status":"start","queue_duration_s":1.9089,"scheduling_latency_s":1.908921}1455gitlab # [ 172.481690] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:08.085Z","message":"No existing merge request to be cleaned up."}1456gitlab # [ 172.483457] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:08.091Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"351870bb4a0568a51dac1294","created_at":"2026-07-12T13:13:06.157Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-e91319b8f6224ca8","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b32ea7f8ec0ce92aadf2d0a0c6fdd096","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.166Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-351870bb4a0568a51dac1294: done: 0.015777 sec","job_status":"done","queue_duration_s":1.9089,"scheduling_latency_s":1.908921,"redis_calls":10,"redis_duration_s":0.002536,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00148,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015777,"completed_at":"2026-07-12T13:13:08.091Z","load_balancing_strategy":"primary","db_duration_s":0.001533,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 172.490997] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:08.092Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8db6b1d7c99a20231ae8c6f5","created_at":"2026-07-12T13:13:06.157Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-e91319b8f6224ca8","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b32ea7f8ec0ce92aadf2d0a0c6fdd096","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.166Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8db6b1d7c99a20231ae8c6f5: start","job_status":"start","queue_duration_s":1.925972,"scheduling_latency_s":1.925994}1458gitlab # [ 172.571395] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:08.102Z","message":"No existing merge request to be cleaned up."}1459gitlab # [ 172.573165] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:08.109Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8db6b1d7c99a20231ae8c6f5","created_at":"2026-07-12T13:13:06.157Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-e91319b8f6224ca8","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b32ea7f8ec0ce92aadf2d0a0c6fdd096","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.166Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8db6b1d7c99a20231ae8c6f5: done: 0.016611 sec","job_status":"done","queue_duration_s":1.925972,"scheduling_latency_s":1.925994,"redis_calls":10,"redis_duration_s":0.002809,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001287,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001522,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016611,"completed_at":"2026-07-12T13:13:08.109Z","load_balancing_strategy":"primary","db_duration_s":0.00178,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 172.575404] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:08.110Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"24c7d939a46760c65589cb4f","created_at":"2026-07-12T13:13:06.157Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-e91319b8f6224ca8","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b32ea7f8ec0ce92aadf2d0a0c6fdd096","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.166Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-24c7d939a46760c65589cb4f: start","job_status":"start","queue_duration_s":1.943973,"scheduling_latency_s":1.943995}1461gitlab # [ 172.647439] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:08.120Z","message":"No existing merge request to be cleaned up."}1462gitlab # [ 172.649224] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:08.126Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"24c7d939a46760c65589cb4f","created_at":"2026-07-12T13:13:06.157Z","trace_propagation_headers":{"sentry-trace":"430dfcaa8b1b4762bcff040f9de4d95c-e91319b8f6224ca8","baggage":"sentry-trace_id=430dfcaa8b1b4762bcff040f9de4d95c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b32ea7f8ec0ce92aadf2d0a0c6fdd096","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:06.166Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-24c7d939a46760c65589cb4f: done: 0.015881 sec","job_status":"done","queue_duration_s":1.943973,"scheduling_latency_s":1.943995,"redis_calls":10,"redis_duration_s":0.002802,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001831,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015881,"completed_at":"2026-07-12T13:13:08.126Z","load_balancing_strategy":"primary","db_duration_s":0.001723,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 172.985859] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 4450987755 wd_nsec: 44509880271464gitlab # [ 175.994976] setup-gitlab-start[2754]: W, [2026-07-12T13:13:14.750629 #2754] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1465gitlab # [ 199.529447] runuser[2753]: pam_unix(runuser:session): session closed for user gitlab1466gitlab # [ 199.533809] setup-gitlab-start[2989]: +++ date -d '+7 days' +%F1467gitlab # [ 199.537760] setup-gitlab-start[2988]: ++ jq -r .token1468gitlab # [ 199.541524] setup-gitlab-start[2987]: ++ curl -fs -X POST -H 'Authorization: Bearer ac4d0e823d28e961d6cbbd2dd3fac36c2ec392290e9d6ba879f7424884906152' -H 'Content-Type: application/json' -d '{"name":"nixbot","scopes":["api"],"expires_at":"2026-07-19"}' http://gitlab/api/v4/users/1/personal_access_tokens1469gitlab # [ 200.242851] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:38.997Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"5595c064ff93140ccc28f5b6","created_at":"2026-07-12T13:13:38.940Z","trace_propagation_headers":{"sentry-trace":"b303ba900f7f43d1959ba7d9172139fd-9531bb775d824bb3","baggage":"sentry-trace_id=b303ba900f7f43d1959ba7d9172139fd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CG8V0D2RHWGB0D40CJ97","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:644c7bdf56e0b06051afbb4a50760e2bc1d2f96521d5398b42bdd999aa1196fb","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:38.992Z","job_size_bytes":451,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-5595c064ff93140ccc28f5b6: start","job_status":"start","queue_duration_s":0.005339,"scheduling_latency_s":0.005402}1470gitlab # [ 200.256207] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:39 +0000] "POST /api/v4/users/1/personal_access_tokens HTTP/1.1" 201 267 "" "curl/8.20.0" 6801471gitlab # [ 200.309790] setup-gitlab-start[2701]: + TOKEN=glpat-BPYeXl_978Mwrn9ieUriAG86MQp1OjEH.01.0w0tfwmok1472gitlab # [ 200.310891] setup-gitlab-start[2701]: + test -n glpat-BPYeXl_978Mwrn9ieUriAG86MQp1OjEH.01.0w0tfwmok1473gitlab # [ 200.311650] setup-gitlab-start[2701]: + test glpat-BPYeXl_978Mwrn9ieUriAG86MQp1OjEH.01.0w0tfwmok '!=' null1474gitlab # [ 200.312830] setup-gitlab-start[2701]: + mkdir -p /var/lib/secrets1475gitlab # [ 200.319166] setup-gitlab-start[2701]: + echo glpat-BPYeXl_978Mwrn9ieUriAG86MQp1OjEH.01.0w0tfwmok1476gitlab # [ 200.321356] setup-gitlab-start[2701]: + chmod 644 /var/lib/secrets/gitlab-token1477gitlab # [ 200.323136] setup-gitlab-start[2701]: + curl -fs -X POST -H 'PRIVATE-TOKEN: glpat-BPYeXl_978Mwrn9ieUriAG86MQp1OjEH.01.0w0tfwmok' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1478gitlab # [ 200.385388] sidekiq-cluster[2163]: {"severity":"WARN","time":"2026-07-12T13:13:39.140Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"5595c064ff93140ccc28f5b6","created_at":"2026-07-12T13:13:38.940Z","trace_propagation_headers":{"sentry-trace":"b303ba900f7f43d1959ba7d9172139fd-9531bb775d824bb3","baggage":"sentry-trace_id=b303ba900f7f43d1959ba7d9172139fd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CG8V0D2RHWGB0D40CJ97","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:644c7bdf56e0b06051afbb4a50760e2bc1d2f96521d5398b42bdd999aa1196fb","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:38.992Z","job_size_bytes":451,"pid":2163,"sidekiq_tid":"lymb","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-5595c064ff93140ccc28f5b6: fail: 0.141825 sec","job_status":"fail","queue_duration_s":0.005339,"scheduling_latency_s":0.005402,"redis_calls":11,"redis_duration_s":0.003397,"redis_read_bytes":137,"redis_write_bytes":1317,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001181,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001583,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000633,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039195,"duration_s":0.141825,"completed_at":"2026-07-12T13:13:39.139Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.027244,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 201.569668] gitaly[1404]: time="2026-07-12T13:13:40.325Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-12T13:13:50.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:40.324" pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1480gitlab # [ 201.572245] gitaly[1404]: time="2026-07-12T13:13:40.325Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-12T13:13:50.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:40.324" grpc.time_ms=0.349 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1481gitlab # [ 201.760886] gitaly[1404]: time="2026-07-12T13:13:40.517Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-12T13:13:50.196" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:40.517" pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1482gitlab # [ 201.802416] gitaly[1404]: time="2026-07-12T13:13:40.517Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-12T13:13:50.196" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:40.517" grpc.time_ms=0.491 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1483gitlab # [ 201.839716] gitaly[1404]: time="2026-07-12T13:13:40.596Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 diskcache=81e89a85-dc2e-4828-81be-a9c9671cf70d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-12T13:13:50.205" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:40.526" pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1484gitlab # [ 201.841671] gitaly[1404]: time="2026-07-12T13:13:40.596Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=327 command.oublock=32 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-12T13:13:50.205" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:40.526" grpc.time_ms=70.14 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1485gitlab # [ 201.901749] gitaly[1404]: time="2026-07-12T13:13:40.658Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-12T13:13:50.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:40.657" pid=1404 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1486gitlab # [ 201.903746] gitaly[1404]: time="2026-07-12T13:13:40.658Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-12T13:13:50.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:40.657" grpc.time_ms=1.288 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1487gitlab # [ 201.960813] gitaly[1404]: time="2026-07-12T13:13:40.717Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-12T13:13:50.051" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:40.701" grpc.time_ms=14.968 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1488gitlab # [ 202.043575] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:40.798Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b9d8f80e22ba882984bd77a6","created_at":"2026-07-12T13:13:40.733Z","trace_propagation_headers":{"sentry-trace":"28c1c5efe55c415cb4695cce247472a9-886b8b6833ea4e65","baggage":"sentry-trace_id=28c1c5efe55c415cb4695cce247472a9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CH0R705JDTF2M2DS4044","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:40.791Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b9d8f80e22ba882984bd77a6: start","job_status":"start","queue_duration_s":0.006765,"scheduling_latency_s":0.006838}1489gitlab # [ 202.087389] gitaly[1404]: time="2026-07-12T13:13:40.826Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-12T13:13:50.174" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:40.825" pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1490gitlab # [ 202.089898] gitaly[1404]: time="2026-07-12T13:13:40.826Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-12T13:13:50.174" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:40.825" grpc.time_ms=1.01 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1491gitlab # [ 202.117458] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:40.873Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b9d8f80e22ba882984bd77a6","created_at":"2026-07-12T13:13:40.733Z","trace_propagation_headers":{"sentry-trace":"28c1c5efe55c415cb4695cce247472a9-886b8b6833ea4e65","baggage":"sentry-trace_id=28c1c5efe55c415cb4695cce247472a9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CH0R705JDTF2M2DS4044","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:40.791Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b9d8f80e22ba882984bd77a6: done: 0.075092 sec","job_status":"done","queue_duration_s":0.006765,"scheduling_latency_s":0.006838,"redis_calls":10,"redis_duration_s":0.005437,"redis_read_bytes":8,"redis_write_bytes":1165,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002653,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002784,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":7,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.041086786,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.075092,"completed_at":"2026-07-12T13:13:40.873Z","load_balancing_strategy":"primary","db_duration_s":0.012347,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1492gitlab # [ 202.119759] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:40.875Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"d0d5fbd06a7f7a645a170d10","created_at":"2026-07-12T13:13:40.804Z","trace_propagation_headers":{"sentry-trace":"28c1c5efe55c415cb4695cce247472a9-886b8b6833ea4e65","baggage":"sentry-trace_id=28c1c5efe55c415cb4695cce247472a9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CH0R705JDTF2M2DS4044","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:40.817Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-d0d5fbd06a7f7a645a170d10: start","job_status":"start","queue_duration_s":0.057929,"scheduling_latency_s":0.057963}1493gitlab # [ 202.203214] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:40.959Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"d0d5fbd06a7f7a645a170d10","created_at":"2026-07-12T13:13:40.804Z","trace_propagation_headers":{"sentry-trace":"28c1c5efe55c415cb4695cce247472a9-886b8b6833ea4e65","baggage":"sentry-trace_id=28c1c5efe55c415cb4695cce247472a9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CH0R705JDTF2M2DS4044","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:40.817Z","job_size_bytes":2,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-d0d5fbd06a7f7a645a170d10: done: 0.084089 sec","job_status":"done","queue_duration_s":0.057929,"scheduling_latency_s":0.057963,"redis_calls":14,"redis_duration_s":0.003444,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000675,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001646,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001123,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.060098141,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.084089,"completed_at":"2026-07-12T13:13:40.959Z","load_balancing_strategy":"primary","db_duration_s":0.017154,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1494gitlab # [ 202.267753] gitaly[1404]: time="2026-07-12T13:13:41.024Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 diskcache=155c72f0-8e67-4211-9317-9b102a1895c6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-12T13:13:50.180" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:40.830" pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1495gitlab # [ 202.269378] gitaly[1404]: time="2026-07-12T13:13:41.024Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=327 command.oublock=32 command.real_time_ms=160 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-12T13:13:50.180" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:40.830" grpc.time_ms=193.691 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1496gitlab # [ 202.276852] gitaly[1404]: time="2026-07-12T13:13:41.033Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-12T13:13:51.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:41.032" pid=1404 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1497gitlab # [ 202.278203] gitaly[1404]: time="2026-07-12T13:13:41.033Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-12T13:13:51.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:41.032" grpc.time_ms=0.556 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1498gitlab # [ 202.349971] gitaly[1404]: time="2026-07-12T13:13:41.045Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-12T13:13:51.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:41.037" grpc.time_ms=7.028 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1499gitlab # [ 202.351279] gitaly[1404]: time="2026-07-12T13:13:41.070Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-12T13:13:51.040" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:41.070" grpc.time_ms=0.134 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1500gitlab # [ 202.352084] gitaly[1404]: time="2026-07-12T13:13:41.076Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-12T13:13:51.045" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:41.076" grpc.time_ms=0.251 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1501gitlab # [ 202.470188] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:41.226Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"e2ddcd307e86a4e964490151","created_at":"2026-07-12T13:13:41.217Z","trace_propagation_headers":{"sentry-trace":"28c1c5efe55c415cb4695cce247472a9-886b8b6833ea4e65","baggage":"sentry-trace_id=28c1c5efe55c415cb4695cce247472a9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CH0R705JDTF2M2DS4044","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:41.223Z","job_size_bytes":5,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-e2ddcd307e86a4e964490151: start","job_status":"start","queue_duration_s":0.001921,"scheduling_latency_s":0.001969}1502gitlab # [ 202.570285] gitaly[1404]: time="2026-07-12T13:13:41.326Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CH0R705JDTF2M2DS4044 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-12T13:13:51.288" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:41.319" grpc.time_ms=6.78 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1503gitlab # [ 202.633470] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:41.389Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"e2ddcd307e86a4e964490151","created_at":"2026-07-12T13:13:41.217Z","trace_propagation_headers":{"sentry-trace":"28c1c5efe55c415cb4695cce247472a9-886b8b6833ea4e65","baggage":"sentry-trace_id=28c1c5efe55c415cb4695cce247472a9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CH0R705JDTF2M2DS4044","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:41.223Z","job_size_bytes":5,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-e2ddcd307e86a4e964490151: done: 0.163769 sec","job_status":"done","queue_duration_s":0.001921,"scheduling_latency_s":0.001969,"redis_calls":12,"redis_duration_s":0.004205,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000987,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002474,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000744,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.089229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052381,"duration_s":0.163769,"completed_at":"2026-07-12T13:13:41.389Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024572,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1504gitlab # [ 202.714483] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:41.470Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"1ac59647e3fe00a4f51ae9b0","created_at":"2026-07-12T13:13:41.293Z","trace_propagation_headers":{"sentry-trace":"28c1c5efe55c415cb4695cce247472a9-886b8b6833ea4e65","baggage":"sentry-trace_id=28c1c5efe55c415cb4695cce247472a9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CH0R705JDTF2M2DS4044","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:41.298Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-1ac59647e3fe00a4f51ae9b0: start","job_status":"start","queue_duration_s":0.171998,"scheduling_latency_s":0.172079}1505gitlab # [ 202.968321] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:41 +0000] "POST /api/v4/projects HTTP/1.1" 201 4795 "" "curl/8.20.0" 26271506gitlab # [ 202.971783] setup-gitlab-start[2701]: + mkdir -p /tmp/test-flake1507gitlab # [ 202.973904] setup-gitlab-start[2701]: + cd /tmp/test-flake1508gitlab # [ 202.977314] setup-gitlab-start[2701]: + git init -b master1509gitlab # [ 202.994203] setup-gitlab-start[3037]: Initialized empty Git repository in /tmp/test-flake/.git/1510gitlab # [ 202.996669] setup-gitlab-start[2701]: + git config user.name test1511gitlab # [ 202.999825] setup-gitlab-start[2701]: + git config user.email test@example.com1512gitlab # [ 203.002621] setup-gitlab-start[2701]: + cat1513gitlab # [ 203.004740] setup-gitlab-start[2701]: + git add flake.nix1514gitlab # [ 203.006576] setup-gitlab-start[2701]: + git commit -m 'initial commit'1515gitlab # [ 203.010585] setup-gitlab-start[3042]: [master (root-commit) cd2a84e] initial commit1516gitlab # [ 203.011988] setup-gitlab-start[3042]: 1 file changed, 10 insertions(+)1517gitlab # [ 203.012751] setup-gitlab-start[3042]: create mode 100644 flake.nix1518gitlab # [ 203.013942] setup-gitlab-start[2701]: + git remote add origin http://oauth2:glpat-BPYeXl_978Mwrn9ieUriAG86MQp1OjEH.01.0w0tfwmok@gitlab/root/test-flake.git1519gitlab # [ 203.019933] setup-gitlab-start[2701]: + git push -u origin master1520gitlab # [ 203.035683] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:41.792Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"1ac59647e3fe00a4f51ae9b0","created_at":"2026-07-12T13:13:41.293Z","trace_propagation_headers":{"sentry-trace":"28c1c5efe55c415cb4695cce247472a9-886b8b6833ea4e65","baggage":"sentry-trace_id=28c1c5efe55c415cb4695cce247472a9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CH0R705JDTF2M2DS4044","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:41.298Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-1ac59647e3fe00a4f51ae9b0: done: 0.322106 sec","job_status":"done","queue_duration_s":0.171998,"scheduling_latency_s":0.172079,"redis_calls":11,"redis_duration_s":0.004137,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001286,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000757,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.239,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.239,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.171998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000521016,"duration_s":0.322106,"completed_at":"2026-07-12T13:13:41.791Z","load_balancing_strategy":"primary","db_duration_s":0.104839,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 203.107163] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:41.862Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"9f838d5c241438e33a08f59d","created_at":"2026-07-12T13:13:41.301Z","trace_propagation_headers":{"sentry-trace":"28c1c5efe55c415cb4695cce247472a9-886b8b6833ea4e65","baggage":"sentry-trace_id=28c1c5efe55c415cb4695cce247472a9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CH0R705JDTF2M2DS4044","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:41.305Z","job_size_bytes":89,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-9f838d5c241438e33a08f59d: start","job_status":"start","queue_duration_s":0.557479,"scheduling_latency_s":0.557522}1522gitlab # [ 203.173246] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:41.929Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"9f838d5c241438e33a08f59d","created_at":"2026-07-12T13:13:41.301Z","trace_propagation_headers":{"sentry-trace":"28c1c5efe55c415cb4695cce247472a9-886b8b6833ea4e65","baggage":"sentry-trace_id=28c1c5efe55c415cb4695cce247472a9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CH0R705JDTF2M2DS4044","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:41.305Z","job_size_bytes":89,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-9f838d5c241438e33a08f59d: done: 0.066693 sec","job_status":"done","queue_duration_s":0.557479,"scheduling_latency_s":0.557522,"redis_calls":11,"redis_duration_s":0.003223,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000715,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001946,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000562,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000430781,"duration_s":0.066693,"completed_at":"2026-07-12T13:13:41.929Z","load_balancing_strategy":"primary","db_duration_s":0.021227,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 203.232610] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:41 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 1871524gitlab # [ 204.233557] gitaly[1404]: time="2026-07-12T13:13:42.989Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CKV8CDCMV9PFT8GJB3FR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:42.976" grpc.time_ms=12.855 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1525gitlab # [ 204.263896] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:42 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.54.0" 9971526gitlab # [ 205.010362] gitaly[1404]: time="2026-07-12T13:13:43.766Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-12T13:13:53.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:43.752" grpc.time_ms=13.61 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1527gitlab # [ 205.070077] gitaly[1404]: time="2026-07-12T13:13:43.826Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-07-12T13:14:13.017" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-07-12T13:13:43.818" grpc.time_ms=8.158 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1528gitlab # [ 205.099299] gitaly[1404]: time="2026-07-12T13:13:43.855Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 duration_ms=592ns method=POST pid=1404 status=200 url="http://unix/api/v4/internal/allowed"1529gitlab # [ 205.134794] gitaly[1404]: time="2026-07-12T13:13:43.891Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 duration_ms=34ns method=POST pid=1404 status=200 url="http://unix/api/v4/internal/pre_receive"1530gitlab # [ 205.137297] gitaly[1404]: time="2026-07-12T13:13:43.893Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5322 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:43.262" grpc.time_ms=631.253 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1531gitlab # [ 205.214748] gitaly[1404]: time="2026-07-12T13:13:43.971Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:43.970" grpc.time_ms=0.89 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1532gitlab # [ 205.271942] gitaly[1404]: time="2026-07-12T13:13:44.027Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:44.026" grpc.time_ms=0.918 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1533gitlab # [ 205.313656] gitaly[1404]: time="2026-07-12T13:13:44.070Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4793 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:44.069" grpc.time_ms=0.358 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1534gitlab # [ 205.401604] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:44.156Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 cd2a84e64b1f23a1dc951887d4aadcf41e00be99 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0c33cb89a9ed4d78e12d3a73","created_at":"2026-07-12T13:13:44.148Z","trace_propagation_headers":{"sentry-trace":"9d8017c6005a468fad50b400fa8d6754-de9971973dce46a5","baggage":"sentry-trace_id=9d8017c6005a468fad50b400fa8d6754,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CMVKQGJG85YCACDZ7CJ4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:44.153Z","job_size_bytes":185,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0c33cb89a9ed4d78e12d3a73: start","job_status":"start","queue_duration_s":0.002751,"scheduling_latency_s":0.002797}1535gitlab # [ 205.419134] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:44.174Z","message":"changes: \"0000000000000000000000000000000000000000 cd2a84e64b1f23a1dc951887d4aadcf41e00be99 refs/heads/master\\n\""}1536gitlab # [ 205.444477] gitaly[1404]: time="2026-07-12T13:13:44.201Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-12T13:13:54.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:44.192" grpc.time_ms=8.613 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1537gitlab # [ 205.468503] gitaly[1404]: time="2026-07-12T13:13:44.225Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-12T13:13:54.026" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:44.216" grpc.time_ms=8.056 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1538gitlab # [ 205.478631] gitaly[1404]: time="2026-07-12T13:13:44.235Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=34 command.spawn_token_fork_ms=6 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-12T13:13:54.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:44.200" grpc.time_ms=35.114 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1539gitlab # [ 205.498775] gitaly[1404]: time="2026-07-12T13:13:44.255Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1565 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=8 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-12T13:13:54.045" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:44.235" grpc.time_ms=19.879 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1540gitlab # [ 205.503865] gitaly[1404]: time="2026-07-12T13:13:44.260Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1563 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-12T13:13:54.053" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:44.243" grpc.time_ms=16.706 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1541gitlab # [ 205.519686] gitaly[1404]: time="2026-07-12T13:13:44.275Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 duration_ms=162ns method=POST pid=1404 status=200 url="http://unix/api/v4/internal/post_receive"1542gitlab # [ 205.523191] gitaly[1404]: time="2026-07-12T13:13:44.279Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4816 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:44.112" grpc.time_ms=166.454 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1543gitlab # [ 205.588146] gitaly[1404]: time="2026-07-12T13:13:44.344Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=31 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-07-12T13:13:54.112" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=226 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:44.302" grpc.time_ms=41.639 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1544gitlab # [ 205.610291] gitaly[1404]: time="2026-07-12T13:13:44.366Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 diskcache=2bb79c9f-38cf-4ef3-8dc4-5aa43e7a048d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:43.183" pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1545gitlab # [ 205.626711] gitaly[1404]: time="2026-07-12T13:13:44.383Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=279 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13984 command.oublock=32 command.real_time_ms=1150 command.spawn_token_fork_ms=2 command.system_time_ms=181 command.user_time_ms=98 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:43.183" grpc.time_ms=1183.46 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1546gitlab # [ 205.648577] gitaly[1404]: time="2026-07-12T13:13:44.392Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3942 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:44.391" grpc.time_ms=0.54 pid=1404 span.kind=server system=grpc1547gitlab # [ 205.650386] setup-gitlab-start[3046]: To http://gitlab/root/test-flake.git1548gitlab # [ 205.651398] setup-gitlab-start[3046]: * [new branch] master -> master1549gitlab # [ 205.652600] gitlab-workhorse[1305]: time="2026-07-12T13:13:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521550gitlab # [ 205.653340] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:44 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 13591551gitlab # [ 205.654247] setup-gitlab-start[3046]: branch 'master' set up to track 'origin/master'.1552gitlab # [ 205.656370] systemd[1]: Finished setup-gitlab.service.1553gitlab # [ 205.678847] systemd[1]: Starting nixbot CI service...1554gitlab # [ 205.706456] gitaly[1404]: time="2026-07-12T13:13:44.463Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3944 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:44.461" grpc.time_ms=1.186 pid=1404 span.kind=server system=grpc1555gitlab # [ 205.730918] gitaly[1404]: time="2026-07-12T13:13:44.487Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 diskcache=b74adfb8-159d-4187-899c-dc3a7a06b5f6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-12T13:13:54.166" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:44.357" pid=1404 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1556gitlab # [ 205.747511] gitaly[1404]: time="2026-07-12T13:13:44.487Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=99 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4944 command.oublock=8 command.real_time_ms=122 command.spawn_token_fork_ms=2 command.system_time_ms=78 command.user_time_ms=21 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-12T13:13:54.166" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:44.357" grpc.time_ms=130.352 pid=1404 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1557gitlab # [ 205.771944] gitaly[1404]: time="2026-07-12T13:13:44.528Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-12T13:13:54.027" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:44.528" grpc.time_ms=0.206 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1558gitlab # [ 205.807320] gitaly[1404]: time="2026-07-12T13:13:44.563Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=933 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-12T13:13:54.053" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:44.553" grpc.time_ms=10.19 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1559gitlab # [ 205.872475] gitaly[1404]: time="2026-07-12T13:13:44.629Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=340 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-07-12T13:14:14.023" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:44.623" grpc.time_ms=5.405 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1560gitlab # [ 205.898094] gitaly[1404]: time="2026-07-12T13:13:44.648Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-12T13:13:54.147" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:44.648" grpc.time_ms=0.236 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1561gitlab # [ 205.900445] gitaly[1404]: time="2026-07-12T13:13:44.657Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=340 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-07-12T13:13:54.151" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-07-12T13:13:44.652" grpc.time_ms=4.612 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1562gitlab # [ 205.921059] gitaly[1404]: time="2026-07-12T13:13:44.677Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-12T13:13:54.171" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:44.671" grpc.time_ms=5.801 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1563gitlab # [ 205.930948] gitaly[1404]: time="2026-07-12T13:13:44.687Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-12T13:13:54.182" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:44.682" grpc.time_ms=5.034 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1564gitlab # [ 205.950116] gitaly[1404]: time="2026-07-12T13:13:44.706Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=958 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-12T13:14:14.096" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:44.696" grpc.time_ms=10.007 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1565gitlab # [ 206.270785] gitaly[1404]: time="2026-07-12T13:13:45.027Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-07-12T13:13:55.004" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:45.025" grpc.time_ms=1.735 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1566gitlab # [ 206.304525] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:45.060Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 cd2a84e64b1f23a1dc951887d4aadcf41e00be99 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0c33cb89a9ed4d78e12d3a73","created_at":"2026-07-12T13:13:44.148Z","trace_propagation_headers":{"sentry-trace":"9d8017c6005a468fad50b400fa8d6754-de9971973dce46a5","baggage":"sentry-trace_id=9d8017c6005a468fad50b400fa8d6754,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CMVKQGJG85YCACDZ7CJ4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:44.153Z","job_size_bytes":185,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0c33cb89a9ed4d78e12d3a73: done: 0.904261 sec","job_status":"done","queue_duration_s":0.002751,"scheduling_latency_s":0.002797,"gitaly_calls":14,"gitaly_duration_s":0.339075,"redis_calls":200,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.064164,"redis_read_bytes":1556,"redis_write_bytes":19431,"redis_cache_calls":14,"redis_cache_duration_s":0.004471,"redis_cache_read_bytes":16,"redis_cache_write_bytes":884,"redis_feature_flag_calls":31,"redis_feature_flag_duration_s":0.016386,"redis_feature_flag_read_bytes":1174,"redis_feature_flag_write_bytes":3829,"redis_queues_calls":8,"redis_queues_duration_s":0.004033,"redis_queues_read_bytes":8,"redis_queues_write_bytes":4932,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003265,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1259,"redis_repository_cache_calls":92,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.020415,"redis_repository_cache_read_bytes":214,"redis_repository_cache_write_bytes":6392,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.015594,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":48,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":48,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":48,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.217,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.234,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.433814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000625499,"exclusive_lock_hold_duration_s":0.025419432000000002,"duration_s":0.904261,"completed_at":"2026-07-12T13:13:45.060Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.080542,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1567gitlab # [ 206.382178] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:45.063Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"8dccb1cdc72cd0923602e6cf","created_at":"2026-07-12T13:13:44.258Z","trace_propagation_headers":{"sentry-trace":"9d8017c6005a468fad50b400fa8d6754-34678fe202744bea","baggage":"sentry-trace_id=9d8017c6005a468fad50b400fa8d6754,sentry-release=Unknown"},"correlation_id":"01KXB7CMVKQGJG85YCACDZ7CJ4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:44.270Z","job_size_bytes":46,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8dccb1cdc72cd0923602e6cf: start","job_status":"start","queue_duration_s":0.792567,"scheduling_latency_s":0.792591}1568gitlab # [ 206.383465] gitaly[1404]: time="2026-07-12T13:13:45.114Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-07-12T19:13:45.111" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:45.112" grpc.time_ms=2.45 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1569gitlab # [ 206.461053] gitaly[1404]: time="2026-07-12T13:13:45.217Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-07-12T13:14:15.008" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:45.209" grpc.time_ms=8.34 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1570gitlab # [ 206.485967] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:45.241Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"8dccb1cdc72cd0923602e6cf","created_at":"2026-07-12T13:13:44.258Z","trace_propagation_headers":{"sentry-trace":"9d8017c6005a468fad50b400fa8d6754-34678fe202744bea","baggage":"sentry-trace_id=9d8017c6005a468fad50b400fa8d6754,sentry-release=Unknown"},"correlation_id":"01KXB7CMVKQGJG85YCACDZ7CJ4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:44.270Z","job_size_bytes":46,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8dccb1cdc72cd0923602e6cf: done: 0.178623 sec","job_status":"done","queue_duration_s":0.792567,"scheduling_latency_s":0.792591,"gitaly_calls":2,"gitaly_duration_s":0.100817,"redis_calls":39,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.011036,"redis_read_bytes":712,"redis_write_bytes":5755,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.003622,"redis_feature_flag_read_bytes":650,"redis_feature_flag_write_bytes":1875,"redis_queues_calls":3,"redis_queues_duration_s":0.000602,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001654,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003264,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":752,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001894,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":12,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000390552,"duration_s":0.178623,"completed_at":"2026-07-12T13:13:45.241Z","load_balancing_strategy":"primary","db_duration_s":0.011772,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1571gitlab # [ 206.492348] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:45.243Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"d5474a576d9b4aae4726ba2d","created_at":"2026-07-12T13:13:44.292Z","trace_propagation_headers":{"sentry-trace":"9d8017c6005a468fad50b400fa8d6754-34678fe202744bea","baggage":"sentry-trace_id=9d8017c6005a468fad50b400fa8d6754,sentry-release=Unknown"},"correlation_id":"01KXB7CMVKQGJG85YCACDZ7CJ4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:44.297Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-d5474a576d9b4aae4726ba2d: start","job_status":"start","queue_duration_s":0.945815,"scheduling_latency_s":0.945837}1572gitlab # [ 206.560632] gitaly[1404]: time="2026-07-12T13:13:45.300Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 diskcache=3912e337-b285-4468-8b03-a4106d721d73 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-12T19:13:45.270" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:45.271" pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1573gitlab # [ 206.561746] gitaly[1404]: time="2026-07-12T13:13:45.300Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1283 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-12T19:13:45.270" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:45.271" grpc.time_ms=29.201 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1574gitlab # [ 206.583066] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:45.339Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"d5474a576d9b4aae4726ba2d","created_at":"2026-07-12T13:13:44.292Z","trace_propagation_headers":{"sentry-trace":"9d8017c6005a468fad50b400fa8d6754-34678fe202744bea","baggage":"sentry-trace_id=9d8017c6005a468fad50b400fa8d6754,sentry-release=Unknown"},"correlation_id":"01KXB7CMVKQGJG85YCACDZ7CJ4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:44.297Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-d5474a576d9b4aae4726ba2d: done: 0.095822 sec","job_status":"done","queue_duration_s":0.945815,"scheduling_latency_s":0.945837,"gitaly_calls":1,"gitaly_duration_s":0.032419,"redis_calls":15,"redis_duration_s":0.005784,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000437,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001708,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.0012,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002439,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.017,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07132806,"duration_s":0.095822,"completed_at":"2026-07-12T13:13:45.339Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016287,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 206.661480] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:45.341Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"af8e3dad644d6d16fc75f270","created_at":"2026-07-12T13:13:44.500Z","trace_propagation_headers":{"sentry-trace":"9d8017c6005a468fad50b400fa8d6754-34678fe202744bea","baggage":"sentry-trace_id=9d8017c6005a468fad50b400fa8d6754,sentry-release=Unknown"},"correlation_id":"01KXB7CMVKQGJG85YCACDZ7CJ4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:44.502Z","job_size_bytes":23,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-af8e3dad644d6d16fc75f270: start","job_status":"start","queue_duration_s":0.838122,"scheduling_latency_s":0.838147}1576gitlab: (finished: waiting for unit setup-gitlab.service, in 207.60 seconds)1577gitlab # [ 206.688300] gitaly[1404]: time="2026-07-12T13:13:45.444Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-07-12T13:14:15.235" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:45.436" grpc.time_ms=8.408 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1578gitlab: waiting for unit nixbot.service1579gitlab # [ 206.698124] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:45.454Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"af8e3dad644d6d16fc75f270","created_at":"2026-07-12T13:13:44.500Z","trace_propagation_headers":{"sentry-trace":"9d8017c6005a468fad50b400fa8d6754-34678fe202744bea","baggage":"sentry-trace_id=9d8017c6005a468fad50b400fa8d6754,sentry-release=Unknown"},"correlation_id":"01KXB7CMVKQGJG85YCACDZ7CJ4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:44.502Z","job_size_bytes":23,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-af8e3dad644d6d16fc75f270: done: 0.113249 sec","job_status":"done","queue_duration_s":0.838122,"scheduling_latency_s":0.838147,"gitaly_calls":1,"gitaly_duration_s":0.01176,"redis_calls":16,"redis_duration_s":0.003917,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000316,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001173,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001737,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000691,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.113249,"completed_at":"2026-07-12T13:13:45.454Z","load_balancing_strategy":"primary","db_duration_s":0.002285,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1580gitlab # [ 206.788425] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:45.458Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4262fa304b86c97ef729f94e","created_at":"2026-07-12T13:13:44.977Z","trace_propagation_headers":{"sentry-trace":"9d8017c6005a468fad50b400fa8d6754-34678fe202744bea","baggage":"sentry-trace_id=9d8017c6005a468fad50b400fa8d6754,sentry-release=Unknown"},"correlation_id":"01KXB7CMVKQGJG85YCACDZ7CJ4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1edc135e9b2e7b76ec0c673a04f3f13bf3c82a46a580838b24fe03ac9923ce3b","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:44.987Z","job_size_bytes":467,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4262fa304b86c97ef729f94e: start","job_status":"start","queue_duration_s":0.471504,"scheduling_latency_s":0.471553}1581gitlab # [ 206.790062] gitaly[1404]: time="2026-07-12T13:13:45.499Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:15.298" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:45.498" grpc.time_ms=0.723 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1582gitlab # [ 206.872258] gitaly[1404]: time="2026-07-12T13:13:45.628Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=123 command.spawn_token_fork_ms=117 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-12T13:13:55.002" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:45.503" grpc.time_ms=124.99 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1583gitlab # [ 206.889623] nixbot[3169]: {"ts": "2026-07-12T13:13:45.645Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1584gitlab # [ 206.911349] nixbot[3169]: {"ts": "2026-07-12T13:13:45.667Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1585gitlab # [ 206.928361] nixbot[3169]: {"ts": "2026-07-12T13:13:45.684Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1586gitlab # [ 206.936208] nixbot[3169]: {"ts": "2026-07-12T13:13:45.692Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1587gitlab # [ 206.942908] nixbot[3169]: {"ts": "2026-07-12T13:13:45.699Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1588gitlab # [ 206.951719] nixbot[3169]: {"ts": "2026-07-12T13:13:45.708Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1589gitlab # [ 206.955679] nixbot[3169]: {"ts": "2026-07-12T13:13:45.712Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1590gitlab # [ 206.962156] nixbot[3169]: {"ts": "2026-07-12T13:13:45.718Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1591gitlab # [ 206.971628] nixbot[3169]: {"ts": "2026-07-12T13:13:45.728Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1592gitlab # [ 206.975902] gitaly[1404]: time="2026-07-12T13:13:45.732Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-12T13:14:15.530" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:45.730" grpc.time_ms=1.464 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1593gitlab # [ 206.977873] nixbot[3169]: {"ts": "2026-07-12T13:13:45.734Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1594gitlab # [ 206.983451] nixbot[3169]: {"ts": "2026-07-12T13:13:45.740Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1595gitlab # [ 206.986688] gitaly[1404]: time="2026-07-12T13:13:45.743Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=66 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-07-12T13:14:15.538" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:45.739" grpc.time_ms=3.82 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1596gitlab # [ 206.989951] nixbot[3169]: {"ts": "2026-07-12T13:13:45.746Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1597gitlab # [ 206.994097] nixbot[3169]: {"ts": "2026-07-12T13:13:45.750Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1598gitlab # [ 206.996139] nixbot[3169]: {"ts": "2026-07-12T13:13:45.752Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1599gitlab # [ 206.999829] nixbot[3169]: {"ts": "2026-07-12T13:13:45.756Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1600gitlab # [ 207.001935] nixbot[3169]: {"ts": "2026-07-12T13:13:45.758Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1601gitlab # [ 207.003868] nixbot[3169]: {"ts": "2026-07-12T13:13:45.760Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1602gitlab # [ 207.005732] nixbot[3169]: {"ts": "2026-07-12T13:13:45.762Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1603gitlab # [ 207.009486] nixbot[3169]: {"ts": "2026-07-12T13:13:45.766Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1604gitlab # [ 207.011443] nixbot[3169]: {"ts": "2026-07-12T13:13:45.768Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1605gitlab # [ 207.013378] nixbot[3169]: {"ts": "2026-07-12T13:13:45.770Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1606gitlab # [ 207.171373] gitaly[1404]: time="2026-07-12T13:13:45.927Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-12T13:13:55.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:45.915" grpc.time_ms=12.295 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1607gitlab # [ 207.382136] nixbot[3169]: INFO: Started server process [3169]1608gitlab # [ 207.386112] nixbot[3169]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1609gitlab # [ 207.391902] nixbot[3169]: INFO: ::ffff:127.0.0.1:37648 - "GET /health HTTP/1.1" 200 OK1610gitlab # [ 207.402776] systemd[1]: Started nixbot CI service.1611gitlab # [ 207.408160] systemd[1]: Reached target Multi-User System.1612gitlab # [ 207.411795] systemd[1]: Startup finished in 1.640s (kernel) + 4.449s (initrd) + 3min 21.316s (userspace) = 3min 27.406s.1613gitlab # [ 207.704639] gitaly[1404]: time="2026-07-12T13:13:46.460Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=973 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-12T13:14:16.243" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:46.443" grpc.time_ms=16.438 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1614gitlab # [ 207.756090] gitaly[1404]: time="2026-07-12T13:13:46.512Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CQWZ15JMGZQDZMM6ZSJK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-12T13:14:16.002" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:46.502" grpc.time_ms=10.094 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1615gitlab # [ 207.784112] gitaly[1404]: time="2026-07-12T13:13:46.540Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CMVKQGJG85YCACDZ7CJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-07-12T13:14:16.306" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:46.506" grpc.time_ms=34.152 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1616gitlab: (finished: waiting for unit nixbot.service, in 1.07 seconds)1617gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1618gitlab # [ 207.826115] sidekiq-cluster[2163]: {"severity":"WARN","time":"2026-07-12T13:13:46.582Z","class":"CreatePipelineWorker","correlation_id":"01KXB7CMVKQGJG85YCACDZ7CJ4","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"cd2a84e64b1f23a1dc951887d4aadcf41e00be99","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"cd2a84e64b1f23a1dc951887d4aadcf41e00be99","ref":"refs/heads/master"},"retry":0}1619gitlab # [ 207.839133] nixbot[3169]: INFO: ::ffff:127.0.0.1:37654 - "GET /health HTTP/1.1" 200 OK1620gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1621subtest: project discovered and webhook registered1622gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1623gitlab # [ 207.848478] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:46.604Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4262fa304b86c97ef729f94e","created_at":"2026-07-12T13:13:44.977Z","trace_propagation_headers":{"sentry-trace":"9d8017c6005a468fad50b400fa8d6754-34678fe202744bea","baggage":"sentry-trace_id=9d8017c6005a468fad50b400fa8d6754,sentry-release=Unknown"},"correlation_id":"01KXB7CMVKQGJG85YCACDZ7CJ4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1edc135e9b2e7b76ec0c673a04f3f13bf3c82a46a580838b24fe03ac9923ce3b","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:44.987Z","job_size_bytes":467,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4262fa304b86c97ef729f94e: done: 1.145963 sec","job_status":"done","queue_duration_s":0.471504,"scheduling_latency_s":0.471553,"gitaly_calls":7,"gitaly_duration_s":0.265152,"redis_calls":53,"redis_duration_s":0.028398,"redis_read_bytes":171,"redis_write_bytes":4426,"redis_cache_calls":4,"redis_cache_duration_s":0.001043,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.006021,"redis_feature_flag_read_bytes":18,"redis_feature_flag_write_bytes":2433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012642,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004415,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004277,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":40,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":40,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.069,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.064,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.663581,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000394184,"duration_s":1.145963,"completed_at":"2026-07-12T13:13:46.604Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.170929,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1624gitlab # [ 207.927152] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:46.683Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"73b74a7c0cc338583b291d49","created_at":"2026-07-12T13:13:45.227Z","trace_propagation_headers":{"sentry-trace":"9d8017c6005a468fad50b400fa8d6754-9dbec68f80bc4480","baggage":"sentry-trace_id=9d8017c6005a468fad50b400fa8d6754,sentry-release=Unknown"},"correlation_id":"01KXB7CMVKQGJG85YCACDZ7CJ4","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:45.232Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-73b74a7c0cc338583b291d49: start","job_status":"start","queue_duration_s":1.450774,"scheduling_latency_s":1.450825}1625gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.15 seconds)1626gitlab # [ 207.974673] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:46.730Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"73b74a7c0cc338583b291d49","created_at":"2026-07-12T13:13:45.227Z","trace_propagation_headers":{"sentry-trace":"9d8017c6005a468fad50b400fa8d6754-9dbec68f80bc4480","baggage":"sentry-trace_id=9d8017c6005a468fad50b400fa8d6754,sentry-release=Unknown"},"correlation_id":"01KXB7CMVKQGJG85YCACDZ7CJ4","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:45.232Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-73b74a7c0cc338583b291d49: done: 0.047702 sec","job_status":"done","queue_duration_s":1.450774,"scheduling_latency_s":1.450825,"redis_calls":19,"redis_duration_s":0.005992,"redis_read_bytes":21,"redis_write_bytes":4288,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001024,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.001162,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2259,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002855,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.007922516,"duration_s":0.047702,"completed_at":"2026-07-12T13:13:46.730Z","load_balancing_strategy":"primary","db_duration_s":0.00579,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627gitlab # [ 207.980085] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:46.735Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"00d2f8b1af48166b614cd9e4","created_at":"2026-07-12T13:13:46.717Z","trace_propagation_headers":{"sentry-trace":"9d8017c6005a468fad50b400fa8d6754-9ff606136d224af3","baggage":"sentry-trace_id=9d8017c6005a468fad50b400fa8d6754,sentry-release=Unknown"},"correlation_id":"01KXB7CMVKQGJG85YCACDZ7CJ4","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:46.722Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-00d2f8b1af48166b614cd9e4: start","job_status":"start","queue_duration_s":0.012945,"scheduling_latency_s":0.012978}1628gitlab # [ 208.049048] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.20.0" 681629gitlab # [ 208.052934] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:46.809Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"00d2f8b1af48166b614cd9e4","created_at":"2026-07-12T13:13:46.717Z","trace_propagation_headers":{"sentry-trace":"9d8017c6005a468fad50b400fa8d6754-9ff606136d224af3","baggage":"sentry-trace_id=9d8017c6005a468fad50b400fa8d6754,sentry-release=Unknown"},"correlation_id":"01KXB7CMVKQGJG85YCACDZ7CJ4","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:46.722Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-00d2f8b1af48166b614cd9e4: done: 0.074205 sec","job_status":"done","queue_duration_s":0.012945,"scheduling_latency_s":0.012978,"redis_calls":11,"redis_duration_s":0.0038699999999999997,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000574,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001963,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001333,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000372115,"duration_s":0.074205,"completed_at":"2026-07-12T13:13:46.809Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015687,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1630gitlab # [ 208.157157] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:46 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 7691631gitlab # [ 208.158786] nixbot[3169]: {"ts": "2026-07-12T13:13:46.914Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1632gitlab # [ 208.187838] nixbot[3169]: {"ts": "2026-07-12T13:13:46.944Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1633gitlab # [ 208.275247] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 701634gitlab # [ 208.277989] nixbot[3169]: {"ts": "2026-07-12T13:13:47.033Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1635gitlab # [ 208.279994] nixbot[3169]: {"ts": "2026-07-12T13:13:47.035Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1636gitlab # [ 208.379109] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:47 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 868 "" "python-httpx/0.28.1" 941637gitlab # [ 208.381213] nixbot[3169]: {"ts": "2026-07-12T13:13:47.137Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1638gitlab # [ 208.656506] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:47 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 2591639gitlab # [ 208.658413] nixbot[3169]: {"ts": "2026-07-12T13:13:47.414Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1640gitlab # [ 208.749695] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "python-httpx/0.28.1" 731641gitlab # [ 208.751686] nixbot[3169]: {"ts": "2026-07-12T13:13:47.507Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1642gitlab # [ 208.860266] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:47 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 868 "" "python-httpx/0.28.1" 1051643gitlab # [ 208.862881] nixbot[3169]: {"ts": "2026-07-12T13:13:47.618Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1644gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1645gitlab # [ 208.971159] gitaly[1404]: time="2026-07-12T13:13:47.726Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CSBCMAB437EQS14ASP49 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-07-12T13:14:17.208" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:47.709" grpc.time_ms=16.837 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1646gitlab # [ 209.026874] gitaly[1404]: time="2026-07-12T13:13:47.782Z" level=info msg="finished unary call with code OK" catfile.duration_ms=30 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=30 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CSBCMAB437EQS14ASP49 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:17.249" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:47.750" grpc.time_ms=31.499 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1647gitlab # [ 209.065316] gitaly[1404]: time="2026-07-12T13:13:47.821Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CSBCMAB437EQS14ASP49 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-07-12T13:13:57.057" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:47.808" grpc.time_ms=13.015 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1648gitlab # [ 209.112711] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "curl/8.20.0" 541649gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.12 seconds)1650(finished: subtest: project discovered and webhook registered, in 1.27 seconds)1651subtest: push delivers the webhook1652gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1653gitlab # [ 209.140612] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 731 "" "python-httpx/0.28.1" 2681654gitlab # [ 209.143708] nixbot[3169]: {"ts": "2026-07-12T13:13:47.900Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1655gitlab # [ 209.201331] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:47 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 381656gitlab # [ 209.215445] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 661657gitlab # [ 209.220780] nixbot[3169]: {"ts": "2026-07-12T13:13:47.975Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1658gitlab # [ 209.224286] nixbot[3169]: {"ts": "2026-07-12T13:13:47.980Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1659gitlab # [ 209.301466] gitaly[1404]: time="2026-07-12T13:13:48.058Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSNXVCKRTAS6AAXSF89W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.050" grpc.time_ms=7.625 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1660gitlab # [ 209.323622] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:48 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.54.0" 1141661gitlab # [ 209.336547] gitaly[1404]: time="2026-07-12T13:13:48.093Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSQBEA36BFEC0FKCFB6A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.056" grpc.time_ms=36.296 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1662gitlab # [ 209.338584] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:48 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 831663gitlab # Enumerating objects: 5, done.1664gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1665gitlab # Delta compression using up to 4 threads1666gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1667gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 137.00 KiB/s, done.1668gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1669gitlab # [ 209.442480] gitaly[1404]: time="2026-07-12T13:13:48.199Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CST0FC76T2A2JV3MDVKY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.179" pid=1404 remote_ip="2001:db8:1::1" request_sha=083c43590fffa527704b32b8836424e8ed055017 response_bytes=149 span.kind=server system=grpc1670gitlab # [ 209.444078] gitaly[1404]: time="2026-07-12T13:13:48.199Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CST0FC76T2A2JV3MDVKY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.179" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1671gitlab # [ 209.447230] gitlab-workhorse[1305]: time="2026-07-12T13:13:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1491672gitlab # [ 209.448707] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 149 "" "git/2.54.0" 1031673gitlab # [ 209.449926] gitaly[1404]: time="2026-07-12T13:13:48.199Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CST0FC76T2A2JV3MDVKY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.179" grpc.time_ms=19.924 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1674gitlab # [ 209.514235] gitaly[1404]: time="2026-07-12T13:13:48.270Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CSXC2WT8PX72W9D5Q4AM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.251" pid=1404 remote_ip="2001:db8:1::1" request_sha=579b7ad334b2c24090abeab2c3c31eee2d7b1d04 response_bytes=228 span.kind=server system=grpc1675gitlab # [ 209.517507] gitaly[1404]: time="2026-07-12T13:13:48.271Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1205 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=5 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CSXC2WT8PX72W9D5Q4AM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.251" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1676gitlab # [ 209.518771] gitlab-workhorse[1305]: time="2026-07-12T13:13:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2281677gitlab # [ 209.519863] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 228 "" "git/2.54.0" 671678gitlab # [ 209.521081] gitaly[1404]: time="2026-07-12T13:13:48.272Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1205 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=5 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CSXC2WT8PX72W9D5Q4AM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.251" grpc.time_ms=20.005 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1679gitlab # [ 209.676156] gitaly[1404]: time="2026-07-12T13:13:48.431Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CT2AMCS4M88NBBYTHCQH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.415" grpc.time_ms=15.796 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1680gitlab # [ 209.677461] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:48 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 691681gitlab # [ 209.735324] gitaly[1404]: time="2026-07-12T13:13:48.491Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-07-12T13:13:58.292" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=253 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:48.483" grpc.time_ms=7.812 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1682gitlab # [ 209.763463] gitaly[1404]: time="2026-07-12T13:13:48.519Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CT5ADTXRT8BXF3QSZA97 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.505" pid=1404 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1683gitlab # [ 209.764982] gitaly[1404]: time="2026-07-12T13:13:48.519Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=7 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-07-12T13:14:18.006" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-07-12T13:13:48.506" grpc.time_ms=13.025 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1684gitlab # [ 209.767651] gitaly[1404]: time="2026-07-12T13:13:48.519Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CT5ADTXRT8BXF3QSZA97 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.505" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1685gitlab # [ 209.768890] gitlab-workhorse[1305]: time="2026-07-12T13:13:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671686gitlab # [ 209.769986] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 641687gitlab # [ 209.771209] gitaly[1404]: time="2026-07-12T13:13:48.522Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CT5ADTXRT8BXF3QSZA97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.505" grpc.time_ms=14.357 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1688gitlab # [ 209.848233] gitaly[1404]: time="2026-07-12T13:13:48.532Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 duration_ms=119ns method=POST pid=1404 status=200 url="http://unix/api/v4/internal/allowed"1689gitlab # [ 209.849718] gitaly[1404]: time="2026-07-12T13:13:48.558Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 duration_ms=25ns method=POST pid=1404 status=200 url="http://unix/api/v4/internal/pre_receive"1690gitlab # [ 209.850907] gitaly[1404]: time="2026-07-12T13:13:48.559Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5322 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:48.411" grpc.time_ms=147.05 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1691gitlab # [ 209.907118] gitaly[1404]: time="2026-07-12T13:13:48.663Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:48.663" grpc.time_ms=0.519 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1692gitlab # [ 209.961885] gitaly[1404]: time="2026-07-12T13:13:48.717Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:48.716" grpc.time_ms=0.629 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1693gitlab # [ 209.987219] gitaly[1404]: time="2026-07-12T13:13:48.743Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CTBXR8JGE2HK6C8JA9DJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.736" grpc.time_ms=7.29 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1694gitlab # [ 209.989574] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:48 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 751695gitlab # [ 210.028137] gitaly[1404]: time="2026-07-12T13:13:48.784Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4793 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:48.784" grpc.time_ms=0.465 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1696gitlab # [ 210.073457] gitaly[1404]: time="2026-07-12T13:13:48.829Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CTED238B4DHM1M7SXW13 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.810" pid=1404 remote_ip="2001:db8:1::1" request_sha=69dcef142412daaffeeda28f6446e517599d516e response_bytes=209 span.kind=server system=grpc1697gitlab # [ 210.075135] gitaly[1404]: time="2026-07-12T13:13:48.829Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CTED238B4DHM1M7SXW13 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.810" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1698gitlab # [ 210.076524] gitlab-workhorse[1305]: time="2026-07-12T13:13:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091699gitlab # [ 210.077735] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.54.0" 811700gitlab # [ 210.078981] gitaly[1404]: time="2026-07-12T13:13:48.829Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CTED238B4DHM1M7SXW13 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.810" grpc.time_ms=19.028 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1701gitlab # [ 210.181486] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:48.935Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","cd2a84e64b1f23a1dc951887d4aadcf41e00be99 4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"318cfec28b4c6a95340f96a6","created_at":"2026-07-12T13:13:48.931Z","trace_propagation_headers":{"sentry-trace":"98a459f1498b4104adf36ad65fc25c86-7c3b846942354114","baggage":"sentry-trace_id=98a459f1498b4104adf36ad65fc25c86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CSV8RYQFKFMRSE0BTFN4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:48.933Z","job_size_bytes":185,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-318cfec28b4c6a95340f96a6: start","job_status":"start","queue_duration_s":0.002404,"scheduling_latency_s":0.002456}1702gitlab # [ 210.198124] gitaly[1404]: time="2026-07-12T13:13:48.954Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 duration_ms=50ns method=POST pid=1404 status=200 url="http://unix/api/v4/internal/post_receive"1703gitlab # [ 210.198938] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:48.954Z","message":"changes: \"cd2a84e64b1f23a1dc951887d4aadcf41e00be99 4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 refs/heads/master\\n\""}1704gitlab # [ 210.200147] gitaly[1404]: time="2026-07-12T13:13:48.954Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4816 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:48.902" grpc.time_ms=52.239 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1705gitlab # [ 210.252136] gitaly[1404]: time="2026-07-12T13:13:49.008Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 diskcache=f3fe4990-6cc1-4bb7-9dfe-0b6028ca194e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.197" pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1706gitlab # [ 210.253442] gitaly[1404]: time="2026-07-12T13:13:49.009Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=293 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13628 command.oublock=32 command.real_time_ms=794 command.spawn_token_fork_ms=19 command.system_time_ms=221 command.user_time_ms=72 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:48.197" grpc.time_ms=811.426 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1707gitlab # [ 210.254795] gitlab-workhorse[1305]: time="2026-07-12T13:13:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521708gitlab # [ 210.255846] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:49 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 8731709gitlab # To http://gitlab/root/test-flake.git1710gitlab # [ 210.295550] gitaly[1404]: time="2026-07-12T13:13:49.052Z" level=info msg="finished unary call with code OK" catfile.duration_ms=5 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=5 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CTNZ8FNTA5B679V20CH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:19.045" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:49.045" grpc.time_ms=5.988 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1711gitlab # cd2a84e..4fecc7a master -> master1712gitlab # [ 210.321220] gitaly[1404]: time="2026-07-12T13:13:49.077Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=60 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=68 command.spawn_token_fork_ms=7 command.system_time_ms=59 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-12T13:13:59.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:49.007" grpc.time_ms=69.602 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1713gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.23 seconds)1714gitlab: must succeed: git -C /tmp/test-flake rev-parse master1715gitlab # [ 210.343675] gitaly[1404]: time="2026-07-12T13:13:49.100Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CTNZ8FNTA5B679V20CH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-07-12T13:14:19.092" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:49.092" grpc.time_ms=7.346 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1716gitlab # [ 210.369193] gitaly[1404]: time="2026-07-12T13:13:49.125Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=13 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CTNZ8FNTA5B679V20CH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-12T13:13:59.078" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:49.108" grpc.time_ms=16.831 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1717gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.04 seconds)1718gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4fecc7ad7664f93e37c7561aaf9789bb02b83fd9'1719gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4fecc7ad7664f93e37c7561aaf9789bb02b83fd9', in 0.03 seconds)1720gitlab # [ 210.398958] gitaly[1404]: time="2026-07-12T13:13:49.155Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-12T13:13:59.147" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:49.148" grpc.time_ms=7.392 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1721gitlab # [ 210.403693] gitaly[1404]: time="2026-07-12T13:13:49.160Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CTNZ8FNTA5B679V20CH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-12T13:13:59.121" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:49.152" grpc.time_ms=7.96 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1722gitlab # [ 210.417228] nixbot[3169]: INFO: ::ffff:127.0.0.1:37666 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 HTTP/1.1" 200 OK1723gitlab # [ 210.429950] gitaly[1404]: time="2026-07-12T13:13:49.186Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-07-12T13:13:59.178" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:49.179" grpc.time_ms=7.068 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1724gitlab # [ 210.446178] gitaly[1404]: time="2026-07-12T13:13:49.202Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-07-12T13:14:19.092" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:49.193" grpc.time_ms=8.344 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1725gitlab # [ 210.462802] gitaly[1404]: time="2026-07-12T13:13:49.219Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=345 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-07-12T13:13:59.214" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-07-12T13:13:49.215" grpc.time_ms=4.168 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1726gitlab # [ 210.467790] gitaly[1404]: time="2026-07-12T13:13:49.224Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CTNZ8FNTA5B679V20CH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-12T13:13:59.192" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:49.223" grpc.time_ms=0.282 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1727gitlab # [ 210.480273] gitaly[1404]: time="2026-07-12T13:13:49.236Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-12T13:13:59.228" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:49.229" grpc.time_ms=7.523 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1728gitlab # [ 210.482640] gitaly[1404]: time="2026-07-12T13:13:49.239Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CTNZ8FNTA5B679V20CH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-12T13:13:59.201" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:49.232" grpc.time_ms=6.617 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1729gitlab # [ 210.596121] gitaly[1404]: time="2026-07-12T13:13:49.352Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CTNZ8FNTA5B679V20CH6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4159 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:49.351" grpc.time_ms=0.9 pid=1404 span.kind=server system=grpc1730gitlab # [ 210.635711] gitaly[1404]: time="2026-07-12T13:13:49.392Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-07-12T13:13:59.009" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:49.390" grpc.time_ms=1.145 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1731gitlab # [ 210.638296] gitaly[1404]: time="2026-07-12T13:13:49.394Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CTNZ8FNTA5B679V20CH6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4161 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:49.394" grpc.time_ms=0.408 pid=1404 span.kind=server system=grpc1732gitlab # [ 210.659793] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:49.416Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","cd2a84e64b1f23a1dc951887d4aadcf41e00be99 4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"318cfec28b4c6a95340f96a6","created_at":"2026-07-12T13:13:48.931Z","trace_propagation_headers":{"sentry-trace":"98a459f1498b4104adf36ad65fc25c86-7c3b846942354114","baggage":"sentry-trace_id=98a459f1498b4104adf36ad65fc25c86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CSV8RYQFKFMRSE0BTFN4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-12T13:13:48.933Z","job_size_bytes":185,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-318cfec28b4c6a95340f96a6: done: 0.480681 sec","job_status":"done","queue_duration_s":0.002404,"scheduling_latency_s":0.002456,"gitaly_calls":7,"gitaly_duration_s":0.171953,"redis_calls":108,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.050304,"redis_read_bytes":349,"redis_write_bytes":12820,"redis_cache_calls":5,"redis_cache_duration_s":0.001393,"redis_cache_read_bytes":13,"redis_cache_write_bytes":347,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000508,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":323,"redis_queues_calls":8,"redis_queues_duration_s":0.001393,"redis_queues_read_bytes":8,"redis_queues_write_bytes":6766,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.002821,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1182,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.03578,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.008409,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.022,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.022,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.220953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000741155,"exclusive_lock_hold_duration_s":0.12616352,"duration_s":0.480681,"completed_at":"2026-07-12T13:13:49.416Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028042,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1733gitlab # [ 210.732686] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:49.417Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"2e2cfa65b21364fc59f845d6","created_at":"2026-07-12T13:13:49.161Z","trace_propagation_headers":{"sentry-trace":"98a459f1498b4104adf36ad65fc25c86-36a9e6b30f74475c","baggage":"sentry-trace_id=98a459f1498b4104adf36ad65fc25c86,sentry-release=Unknown"},"correlation_id":"01KXB7CSV8RYQFKFMRSE0BTFN4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:49.164Z","job_size_bytes":46,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-2e2cfa65b21364fc59f845d6: start","job_status":"start","queue_duration_s":0.253591,"scheduling_latency_s":0.253648}1734gitlab # [ 210.734211] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:49.436Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"2e2cfa65b21364fc59f845d6","created_at":"2026-07-12T13:13:49.161Z","trace_propagation_headers":{"sentry-trace":"98a459f1498b4104adf36ad65fc25c86-36a9e6b30f74475c","baggage":"sentry-trace_id=98a459f1498b4104adf36ad65fc25c86,sentry-release=Unknown"},"correlation_id":"01KXB7CSV8RYQFKFMRSE0BTFN4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:49.164Z","job_size_bytes":46,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-2e2cfa65b21364fc59f845d6: done: 0.019191 sec","job_status":"done","queue_duration_s":0.253591,"scheduling_latency_s":0.253648,"redis_calls":9,"redis_duration_s":0.002122,"redis_read_bytes":23,"redis_write_bytes":782,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001207,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000231,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000684,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":304,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019191,"completed_at":"2026-07-12T13:13:49.436Z","load_balancing_strategy":"primary","db_duration_s":0.001475,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1735gitlab # [ 210.819677] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:49.438Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e6a0b7f771d40d63666d802d","created_at":"2026-07-12T13:13:49.169Z","trace_propagation_headers":{"sentry-trace":"98a459f1498b4104adf36ad65fc25c86-36a9e6b30f74475c","baggage":"sentry-trace_id=98a459f1498b4104adf36ad65fc25c86,sentry-release=Unknown"},"correlation_id":"01KXB7CSV8RYQFKFMRSE0BTFN4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:49.172Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e6a0b7f771d40d63666d802d: start","job_status":"start","queue_duration_s":0.265756,"scheduling_latency_s":0.265779}1736gitlab # [ 210.821254] gitaly[1404]: time="2026-07-12T13:13:49.483Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 diskcache=874b63d7-2af8-4b7d-ac01-cb248c067899 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-12T19:13:49.454" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:49.454" pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1737gitlab # [ 210.822139] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:49.498Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e6a0b7f771d40d63666d802d","created_at":"2026-07-12T13:13:49.169Z","trace_propagation_headers":{"sentry-trace":"98a459f1498b4104adf36ad65fc25c86-36a9e6b30f74475c","baggage":"sentry-trace_id=98a459f1498b4104adf36ad65fc25c86,sentry-release=Unknown"},"correlation_id":"01KXB7CSV8RYQFKFMRSE0BTFN4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:49.172Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e6a0b7f771d40d63666d802d: done: 0.059869 sec","job_status":"done","queue_duration_s":0.265756,"scheduling_latency_s":0.265779,"gitaly_calls":1,"gitaly_duration_s":0.031629,"redis_calls":12,"redis_duration_s":0.002928,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001175,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000645,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001108,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.043304666,"duration_s":0.059869,"completed_at":"2026-07-12T13:13:49.498Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004432,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1738gitlab # [ 210.903223] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:49.499Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"0f956bb285f31c3fefb32981","created_at":"2026-07-12T13:13:49.282Z","trace_propagation_headers":{"sentry-trace":"98a459f1498b4104adf36ad65fc25c86-36a9e6b30f74475c","baggage":"sentry-trace_id=98a459f1498b4104adf36ad65fc25c86,sentry-release=Unknown"},"correlation_id":"01KXB7CSV8RYQFKFMRSE0BTFN4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:70c441c95254e93d7e3252ab2836268e057bbaa792f96439efcc3928d4fdce64","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:49.284Z","job_size_bytes":467,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-0f956bb285f31c3fefb32981: start","job_status":"start","queue_duration_s":0.215336,"scheduling_latency_s":0.215359}1739gitlab # [ 210.972357] gitaly[1404]: time="2026-07-12T13:13:49.483Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=5 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1648 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-12T19:13:49.454" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:49.454" grpc.time_ms=29.012 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1740gitlab # [ 210.973494] gitaly[1404]: time="2026-07-12T13:13:49.521Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:19.420" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:49.521" grpc.time_ms=0.621 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1741gitlab # [ 210.974309] gitaly[1404]: time="2026-07-12T13:13:49.530Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-12T13:13:59.143" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:49.523" grpc.time_ms=6.816 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1742gitlab # [ 210.975204] gitaly[1404]: time="2026-07-12T13:13:49.556Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-12T13:14:19.454" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:49.555" grpc.time_ms=0.85 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1743gitlab # [ 211.054826] gitaly[1404]: time="2026-07-12T13:13:49.562Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=140 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-07-12T13:14:19.459" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:49.559" grpc.time_ms=2.574 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1744gitlab # [ 211.056128] gitaly[1404]: time="2026-07-12T13:13:49.614Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-12T13:13:59.226" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:49.606" grpc.time_ms=7.86 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1745gitlab # [ 211.117975] gitaly[1404]: time="2026-07-12T13:13:49.874Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CTNZ8FNTA5B679V20CH6 diskcache=3d66a7d3-8bc6-401f-b2c0-7b9bbd04e7d7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-12T13:13:59.212" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:49.242" pid=1404 ref=refs/keep-around/cd2a84e64b1f23a1dc951887d4aadcf41e00be99 remote_ip="2001:db8:1::1" revision=cd2a84e64b1f23a1dc951887d4aadcf41e00be99 span.kind=server system=grpc username=root1746gitlab # [ 211.136201] gitaly[1404]: time="2026-07-12T13:13:49.892Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=50 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=856064 command.minflt=5289 command.oublock=8 command.real_time_ms=620 command.spawn_token_fork_ms=1 command.system_time_ms=31 command.user_time_ms=19 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CTNZ8FNTA5B679V20CH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-12T13:13:59.212" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:49.242" grpc.time_ms=632.171 pid=1404 ref=refs/keep-around/cd2a84e64b1f23a1dc951887d4aadcf41e00be99 remote_ip="2001:db8:1::1" revision=cd2a84e64b1f23a1dc951887d4aadcf41e00be99 span.kind=server system=grpc username=root1747gitlab # [ 211.160730] gitaly[1404]: time="2026-07-12T13:13:49.917Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CTNZ8FNTA5B679V20CH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:19.916" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:49.916" grpc.time_ms=0.564 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1748gitlab # [ 211.245342] gitaly[1404]: time="2026-07-12T13:13:50.001Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-12T13:14:19.884" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:49.984" grpc.time_ms=17.022 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1749gitlab # [ 211.283899] gitaly[1404]: time="2026-07-12T13:13:50.040Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=21 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CSV8RYQFKFMRSE0BTFN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-07-12T13:14:20.004" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:50.004" grpc.time_ms=35.628 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1750gitlab # [ 211.295976] sidekiq-cluster[2163]: {"severity":"WARN","time":"2026-07-12T13:13:50.051Z","class":"CreatePipelineWorker","correlation_id":"01KXB7CSV8RYQFKFMRSE0BTFN4","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"cd2a84e64b1f23a1dc951887d4aadcf41e00be99","after":"4fecc7ad7664f93e37c7561aaf9789bb02b83fd9","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"4fecc7ad7664f93e37c7561aaf9789bb02b83fd9","ref":"refs/heads/master"},"retry":0}1751gitlab # [ 211.302231] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:50.058Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"0f956bb285f31c3fefb32981","created_at":"2026-07-12T13:13:49.282Z","trace_propagation_headers":{"sentry-trace":"98a459f1498b4104adf36ad65fc25c86-36a9e6b30f74475c","baggage":"sentry-trace_id=98a459f1498b4104adf36ad65fc25c86,sentry-release=Unknown"},"correlation_id":"01KXB7CSV8RYQFKFMRSE0BTFN4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:70c441c95254e93d7e3252ab2836268e057bbaa792f96439efcc3928d4fdce64","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:49.284Z","job_size_bytes":467,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-0f956bb285f31c3fefb32981: done: 0.558686 sec","job_status":"done","queue_duration_s":0.215336,"scheduling_latency_s":0.215359,"gitaly_calls":7,"gitaly_duration_s":0.087705,"redis_calls":33,"redis_duration_s":0.007305,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000731,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002787,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.00246,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001327,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":30,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":26,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.437458,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.558686,"completed_at":"2026-07-12T13:13:50.058Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023963,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1752gitlab # [ 211.321433] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:50.062Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"37658751-dcdd-40df-8d86-1e368b1352b1\"}"],"class":"WebHookWorker","jid":"83675ad60aabf4e92e85e1cf","created_at":"2026-07-12T13:13:49.374Z","trace_propagation_headers":{"sentry-trace":"98a459f1498b4104adf36ad65fc25c86-36a9e6b30f74475c","baggage":"sentry-trace_id=98a459f1498b4104adf36ad65fc25c86,sentry-release=Unknown"},"correlation_id":"01KXB7CSV8RYQFKFMRSE0BTFN4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ca950a9c0d4b21c867a7e0440b86b96e5cb10b3388210d31774be3d33344844d","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:49.380Z","job_size_bytes":1749,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-83675ad60aabf4e92e85e1cf: start","job_status":"start","queue_duration_s":0.681957,"scheduling_latency_s":0.682027}1753gitlab # [ 211.388539] nixbot[3169]: INFO: ::ffff:127.0.0.1:37682 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1754gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4fecc7ad7664f93e37c7561aaf9789bb02b83fd9'1755gitlab # [ 211.408263] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:50.164Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"37658751-dcdd-40df-8d86-1e368b1352b1\"}"],"class":"WebHookWorker","jid":"83675ad60aabf4e92e85e1cf","created_at":"2026-07-12T13:13:49.374Z","trace_propagation_headers":{"sentry-trace":"98a459f1498b4104adf36ad65fc25c86-36a9e6b30f74475c","baggage":"sentry-trace_id=98a459f1498b4104adf36ad65fc25c86,sentry-release=Unknown"},"correlation_id":"01KXB7CSV8RYQFKFMRSE0BTFN4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ca950a9c0d4b21c867a7e0440b86b96e5cb10b3388210d31774be3d33344844d","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:49.380Z","job_size_bytes":1749,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-83675ad60aabf4e92e85e1cf: done: 0.102114 sec","job_status":"done","queue_duration_s":0.681957,"scheduling_latency_s":0.682027,"redis_calls":19,"redis_duration_s":0.006298000000000001,"redis_read_bytes":31,"redis_write_bytes":5282,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001013,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000315,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3644,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003995,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.008693842000013774,"cpu_s":0.073414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000376864,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","duration_s":0.102114,"completed_at":"2026-07-12T13:13:50.164Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002054,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1756gitlab # [ 211.428891] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:50.166Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"63cf40a6ad22d16768cd8f68","created_at":"2026-07-12T13:13:49.940Z","trace_propagation_headers":{"sentry-trace":"1eb7885f8bd442ed81eba589407b0894-d836823c3457427a","baggage":"sentry-trace_id=1eb7885f8bd442ed81eba589407b0894,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CTNZ8FNTA5B679V20CH6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:49.951Z","job_size_bytes":65,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-63cf40a6ad22d16768cd8f68: start","job_status":"start","queue_duration_s":0.215862,"scheduling_latency_s":0.215885}1757gitlab # [ 211.474917] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:50.231Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"63cf40a6ad22d16768cd8f68","created_at":"2026-07-12T13:13:49.940Z","trace_propagation_headers":{"sentry-trace":"1eb7885f8bd442ed81eba589407b0894-d836823c3457427a","baggage":"sentry-trace_id=1eb7885f8bd442ed81eba589407b0894,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CTNZ8FNTA5B679V20CH6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:49.951Z","job_size_bytes":65,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-63cf40a6ad22d16768cd8f68: done: 0.064312 sec","job_status":"done","queue_duration_s":0.215862,"scheduling_latency_s":0.215885,"redis_calls":19,"redis_duration_s":0.010750000000000001,"redis_read_bytes":145,"redis_write_bytes":2300,"redis_feature_flag_calls":11,"redis_feature_flag_duration_s":0.007439,"redis_feature_flag_read_bytes":138,"redis_feature_flag_write_bytes":1482,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002736,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000575,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000634438,"duration_s":0.064312,"completed_at":"2026-07-12T13:13:50.231Z","load_balancing_strategy":"primary","db_duration_s":0.016612,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1758gitlab # [ 211.555710] gitaly[1404]: time="2026-07-12T13:13:50.241Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CVTQKHF54M0KDFNCXTHB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:50.226" grpc.time_ms=14.53 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1759gitlab # [ 211.563329] gitaly[1404]: time="2026-07-12T13:13:50.306Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CVX4NJT85YWDV3PJDCJ0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:50.287" pid=1404 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1760gitlab # [ 211.565369] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 741761gitlab # [ 211.570115] gitlab-workhorse[1305]: time="2026-07-12T13:13:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671762gitlab # [ 211.573799] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 641763gitlab # [ 211.578661] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:50.235Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"f501604aa30aec28a4e8c13b","created_at":"2026-07-12T13:13:49.953Z","trace_propagation_headers":{"sentry-trace":"1eb7885f8bd442ed81eba589407b0894-d836823c3457427a","baggage":"sentry-trace_id=1eb7885f8bd442ed81eba589407b0894,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CTNZ8FNTA5B679V20CH6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:49.964Z","job_size_bytes":65,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-f501604aa30aec28a4e8c13b: start","job_status":"start","queue_duration_s":0.270879,"scheduling_latency_s":0.270912}1764gitlab # [ 211.647324] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:50.318Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"f501604aa30aec28a4e8c13b","created_at":"2026-07-12T13:13:49.953Z","trace_propagation_headers":{"sentry-trace":"1eb7885f8bd442ed81eba589407b0894-d836823c3457427a","baggage":"sentry-trace_id=1eb7885f8bd442ed81eba589407b0894,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CTNZ8FNTA5B679V20CH6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:49.964Z","job_size_bytes":65,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-f501604aa30aec28a4e8c13b: done: 0.083452 sec","job_status":"done","queue_duration_s":0.270879,"scheduling_latency_s":0.270912,"redis_calls":15,"redis_duration_s":0.011848999999999998,"redis_read_bytes":142,"redis_write_bytes":1431,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.002789,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":431,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00612,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00294,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000507607,"duration_s":0.083452,"completed_at":"2026-07-12T13:13:50.318Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019457,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1765gitlab # [ 211.718942] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:50.324Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","83675ad60aabf4e92e85e1cf"],"class":"WebHooks::LogExecutionWorker","jid":"06205b2f5e0fb4432beec2f0","created_at":"2026-07-12T13:13:50.146Z","trace_propagation_headers":{"sentry-trace":"98a459f1498b4104adf36ad65fc25c86-4f6d26129a60499b","baggage":"sentry-trace_id=98a459f1498b4104adf36ad65fc25c86,sentry-release=Unknown"},"correlation_id":"01KXB7CSV8RYQFKFMRSE0BTFN4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9fa85c1be073d68c6da600f2a694351088881d1d642e90d63bf2c6a0a3381d1f","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:50.157Z","job_size_bytes":2507,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-06205b2f5e0fb4432beec2f0: start","job_status":"start","queue_duration_s":0.167252,"scheduling_latency_s":0.167276}1766gitlab # [ 211.720329] gitaly[1404]: time="2026-07-12T13:13:50.306Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CVX4NJT85YWDV3PJDCJ0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:50.287" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1767gitlab # [ 211.721462] nixbot[3169]: {"ts": "2026-07-12T13:13:50.364Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd2a84e64b1f23a1dc951887d4aadcf41e00be99 \"HTTP/1.1 201 Created\""}1768gitlab # [ 211.722221] nixbot[3169]: {"ts": "2026-07-12T13:13:50.381Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-cd2a84e64b1f-20474a93", "argv0": "bwrap"}1769gitlab # [ 211.723238] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:50.471Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","83675ad60aabf4e92e85e1cf"],"class":"WebHooks::LogExecutionWorker","jid":"06205b2f5e0fb4432beec2f0","created_at":"2026-07-12T13:13:50.146Z","trace_propagation_headers":{"sentry-trace":"98a459f1498b4104adf36ad65fc25c86-4f6d26129a60499b","baggage":"sentry-trace_id=98a459f1498b4104adf36ad65fc25c86,sentry-release=Unknown"},"correlation_id":"01KXB7CSV8RYQFKFMRSE0BTFN4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9fa85c1be073d68c6da600f2a694351088881d1d642e90d63bf2c6a0a3381d1f","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:50.157Z","job_size_bytes":2507,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-06205b2f5e0fb4432beec2f0: done: 0.147057 sec","job_status":"done","queue_duration_s":0.167252,"scheduling_latency_s":0.167276,"redis_calls":10,"redis_duration_s":0.005799,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001911,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003412,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000476,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.026,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.026,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.111459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003696,"duration_s":0.147057,"completed_at":"2026-07-12T13:13:50.471Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006832,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1770gitlab # [ 211.799505] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:50.473Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0f98e046ef0db99e69b776dc","created_at":"2026-07-12T13:13:50.309Z","trace_propagation_headers":{"sentry-trace":"1eb7885f8bd442ed81eba589407b0894-d836823c3457427a","baggage":"sentry-trace_id=1eb7885f8bd442ed81eba589407b0894,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CTNZ8FNTA5B679V20CH6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:50.339Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0f98e046ef0db99e69b776dc: start","job_status":"start","queue_duration_s":0.13386,"scheduling_latency_s":0.133883}1771gitlab # [ 211.817058] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd2a84e64b1f23a1dc951887d4aadcf41e00be99 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 13671772gitlab # [ 211.821105] gitlab-workhorse[1305]: time="2026-07-12T13:13:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3421773gitlab # [ 211.823865] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 342 "" "git/2.54.0" 801774gitlab # [ 211.826706] gitaly[1404]: time="2026-07-12T13:13:50.307Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CVX4NJT85YWDV3PJDCJ0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:50.287" grpc.time_ms=20.368 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1775gitlab # [ 211.901254] gitaly[1404]: time="2026-07-12T13:13:50.390Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CVZ7VA2EACM7C8MJSDGY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:50.373" pid=1404 remote_ip="2001:db8:1::1" request_sha=8957809aade8897dc19ad921215fb7bc9075c4ed response_bytes=342 span.kind=server system=grpc1776gitlab # [ 211.902722] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:50.622Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0f98e046ef0db99e69b776dc","created_at":"2026-07-12T13:13:50.309Z","trace_propagation_headers":{"sentry-trace":"1eb7885f8bd442ed81eba589407b0894-d836823c3457427a","baggage":"sentry-trace_id=1eb7885f8bd442ed81eba589407b0894,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CTNZ8FNTA5B679V20CH6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:50.339Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0f98e046ef0db99e69b776dc: done: 0.149651 sec","job_status":"done","queue_duration_s":0.13386,"scheduling_latency_s":0.133883,"gitaly_calls":3,"gitaly_duration_s":0.009695,"redis_calls":48,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.010309,"redis_read_bytes":208,"redis_write_bytes":6803,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001162,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":16,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001661,"redis_cache_read_bytes":32,"redis_cache_write_bytes":1470,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.001766,"redis_feature_flag_read_bytes":134,"redis_feature_flag_write_bytes":992,"redis_queues_calls":2,"redis_queues_duration_s":0.000301,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.002144,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":840,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000562,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000251,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0013,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":34,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":34,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":22,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.101959,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11938863699999999,"duration_s":0.149651,"completed_at":"2026-07-12T13:13:50.622Z","load_balancing_strategy":"primary","db_duration_s":0.033689,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1777gitlab # [ 211.970446] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:50.624Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c7412d0ffce57324dced740e","created_at":"2026-07-12T13:13:50.535Z","trace_propagation_headers":{"sentry-trace":"1eb7885f8bd442ed81eba589407b0894-758d8be3ee884a07","baggage":"sentry-trace_id=1eb7885f8bd442ed81eba589407b0894,sentry-release=Unknown"},"correlation_id":"01KXB7CTNZ8FNTA5B679V20CH6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:50.539Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c7412d0ffce57324dced740e: start","job_status":"start","queue_duration_s":0.085489,"scheduling_latency_s":0.085512}1778gitlab # [ 211.971861] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:50.654Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c7412d0ffce57324dced740e","created_at":"2026-07-12T13:13:50.535Z","trace_propagation_headers":{"sentry-trace":"1eb7885f8bd442ed81eba589407b0894-758d8be3ee884a07","baggage":"sentry-trace_id=1eb7885f8bd442ed81eba589407b0894,sentry-release=Unknown"},"correlation_id":"01KXB7CTNZ8FNTA5B679V20CH6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:50.539Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c7412d0ffce57324dced740e: done: 0.030318 sec","job_status":"done","queue_duration_s":0.085489,"scheduling_latency_s":0.085512,"redis_calls":10,"redis_duration_s":0.002318,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000421,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001453,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000444,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000349765,"duration_s":0.030318,"completed_at":"2026-07-12T13:13:50.654Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003719,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1779gitlab # [ 212.041072] gitaly[1404]: time="2026-07-12T13:13:50.390Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1198 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CVZ7VA2EACM7C8MJSDGY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:50.373" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1780gitlab # [ 212.121737] gitaly[1404]: time="2026-07-12T13:13:50.391Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1198 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CVZ7VA2EACM7C8MJSDGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:50.373" grpc.time_ms=17.912 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1781gitlab # [ 212.123232] gitaly[1404]: time="2026-07-12T13:13:50.552Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CTNZ8FNTA5B679V20CH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-12T13:14:20.550" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:50.551" grpc.time_ms=0.818 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1782gitlab # [ 212.124057] gitaly[1404]: time="2026-07-12T13:13:50.587Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CTNZ8FNTA5B679V20CH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:20.586" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:50.586" grpc.time_ms=0.61 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1783gitlab # [ 212.124880] gitaly[1404]: time="2026-07-12T13:13:50.610Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CTNZ8FNTA5B679V20CH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:20.608" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:50.609" grpc.time_ms=0.759 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1784gitlab # [ 212.233844] nixbot[3169]: INFO: ::ffff:127.0.0.1:37692 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 HTTP/1.1" 200 OK1785gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4fecc7ad7664f93e37c7561aaf9789bb02b83fd9', in 0.83 seconds)1786gitlab # [ 212.306435] systemd[1]: Started Nix Daemon.1787gitlab # [ 212.336536] gitaly[1404]: time="2026-07-12T13:13:51.091Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CWNECPYFYKEG1BS9PJM1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:51.072" grpc.time_ms=17.661 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1788gitlab # [ 212.338073] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 701789gitlab # [ 212.363368] nix-daemon[3495]: accepted connection from pid 3494, user nixbot1790gitlab # [ 212.368589] nix-daemon[3495]: accepted connection from pid 3492, user nixbot1791gitlab # [ 212.417102] gitaly[1404]: time="2026-07-12T13:13:51.173Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CWQSZZR24WHA4MD65SD5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:51.158" pid=1404 remote_ip="2001:db8:1::1" request_sha=f1e6bb59289c4d43fc3699ed3fc4760ee01ef0e9 response_bytes=216 span.kind=server system=grpc1792gitlab # [ 212.418524] gitaly[1404]: time="2026-07-12T13:13:51.173Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1162 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CWQSZZR24WHA4MD65SD5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:51.158" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1793gitlab # [ 212.456073] gitaly[1404]: time="2026-07-12T13:13:51.212Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1162 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CWQSZZR24WHA4MD65SD5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:13:51.158" grpc.time_ms=15.305 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1794gitlab # [ 212.457261] gitlab-workhorse[1305]: time="2026-07-12T13:13:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161795gitlab # [ 212.458050] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.54.0" 1151796gitlab # [ 212.506566] nixbot[3169]: {"ts": "2026-07-12T13:13:51.263Z", "level": "info", "logger": "nixbot.canceller", "msg": "cancelling build", "build_id": 1, "reason": "superseded"}1797gitlab # [ 212.514399] nix-daemon[3503]: unexpected Nix daemon error: error: interrupted by the user1798gitlab # [ 212.567612] gitaly[1404]: time="2026-07-12T13:13:51.324Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CWX28ZMEBKEDPYXKN455 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:21.322" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:51.323" grpc.time_ms=0.801 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1799gitlab # [ 212.579796] gitaly[1404]: time="2026-07-12T13:13:51.336Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CWXKTA8MCR50C90DCDF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:21.034" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:51.335" grpc.time_ms=0.734 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800gitlab # [ 212.622855] gitaly[1404]: time="2026-07-12T13:13:51.379Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CWX28ZMEBKEDPYXKN455 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-07-12T13:14:21.371" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:51.371" grpc.time_ms=7.672 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1801gitlab # [ 212.647552] gitaly[1404]: time="2026-07-12T13:13:51.404Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=13 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CWX28ZMEBKEDPYXKN455 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-12T13:14:01.064" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:51.384" grpc.time_ms=19.398 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1802gitlab # [ 212.669816] gitaly[1404]: time="2026-07-12T13:13:51.426Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CWX28ZMEBKEDPYXKN455 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-12T13:14:01.105" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:51.425" grpc.time_ms=0.332 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803gitlab # [ 212.672287] gitaly[1404]: time="2026-07-12T13:13:51.428Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CWXKTA8MCR50C90DCDF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-12T13:14:01.232" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:51.422" grpc.time_ms=6.051 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804gitlab # [ 212.718897] gitaly[1404]: time="2026-07-12T13:13:51.475Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CWX28ZMEBKEDPYXKN455 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-12T13:14:01.147" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:51.468" grpc.time_ms=7 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1805gitlab # [ 212.744291] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:51.500Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"ecaad12f11dc8baa193d0b79","created_at":"2026-07-12T13:13:51.493Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-5135e4456c034e94","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.497Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ecaad12f11dc8baa193d0b79: start","job_status":"start","queue_duration_s":0.002314,"scheduling_latency_s":0.002368}1806gitlab # [ 212.771519] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd2a84e64b1f23a1dc951887d4aadcf41e00be99 HTTP/1.1" 201 651 "" "python-httpx/0.28.1" 2311807gitlab # [ 212.773168] nixbot[3169]: {"ts": "2026-07-12T13:13:51.516Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd2a84e64b1f23a1dc951887d4aadcf41e00be99 \"HTTP/1.1 201 Created\""}1808gitlab # [ 212.794485] gitaly[1404]: time="2026-07-12T13:13:51.551Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CWX28ZMEBKEDPYXKN455 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4159 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:51.550" grpc.time_ms=0.656 pid=1404 span.kind=server system=grpc1809gitlab # [ 212.826807] gitaly[1404]: time="2026-07-12T13:13:51.583Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CX56TT5KPGCJBANQV362 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:21.079" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:51.580" grpc.time_ms=2.834 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810gitlab # [ 212.853589] gitaly[1404]: time="2026-07-12T13:13:51.610Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CWX28ZMEBKEDPYXKN455 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4161 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:51.609" grpc.time_ms=0.368 pid=1404 span.kind=server system=grpc1811gitlab # [ 212.871519] gitaly[1404]: time="2026-07-12T13:13:51.628Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CX56TT5KPGCJBANQV362 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-12T13:14:01.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:51.620" grpc.time_ms=7.454 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1812gitlab # [ 212.879248] gitaly[1404]: time="2026-07-12T13:13:51.635Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CWX28ZMEBKEDPYXKN455 diskcache=b4f12b3b-e073-48d0-b9e3-5dbe4901e7d1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-12T13:14:01.176" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:51.497" pid=1404 ref=refs/keep-around/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 remote_ip="2001:db8:1::1" revision=4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 span.kind=server system=grpc username=root1813gitlab # [ 212.880801] gitaly[1404]: time="2026-07-12T13:13:51.636Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=97 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5101 command.oublock=8 command.real_time_ms=127 command.spawn_token_fork_ms=0 command.system_time_ms=84 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CWX28ZMEBKEDPYXKN455 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-12T13:14:01.176" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-12T13:13:51.497" grpc.time_ms=138.61 pid=1404 ref=refs/keep-around/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 remote_ip="2001:db8:1::1" revision=4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 span.kind=server system=grpc username=root1814gitlab # [ 212.884257] gitaly[1404]: time="2026-07-12T13:13:51.640Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CWX28ZMEBKEDPYXKN455 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:21.639" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:51.640" grpc.time_ms=0.431 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab # [ 212.892927] gitaly[1404]: time="2026-07-12T13:13:51.649Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CWXKTA8MCR50C90DCDF9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:51.649" grpc.time_ms=0.355 pid=1404 span.kind=server system=grpc1816gitlab # [ 212.957985] nixbot[3169]: {"ts": "2026-07-12T13:13:51.712Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 \"HTTP/1.1 201 Created\""}1817gitlab # [ 212.959246] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 4471818gitlab # [ 212.971168] nixbot[3169]: {"ts": "2026-07-12T13:13:51.720Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-4fecc7ad7664-87e27a98", "argv0": "bwrap"}1819gitlab # [ 213.003956] gitaly[1404]: time="2026-07-12T13:13:51.760Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CWXKTA8MCR50C90DCDF9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:51.759" grpc.time_ms=0.615 pid=1404 span.kind=server system=grpc1820gitlab # [ 213.047408] gitaly[1404]: time="2026-07-12T13:13:51.804Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7CWXKTA8MCR50C90DCDF9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:51.802" grpc.time_ms=1.62 pid=1404 span.kind=server system=grpc1821gitlab # [ 213.051192] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd2a84e64b1f23a1dc951887d4aadcf41e00be99 HTTP/1.1" 201 665 "" "python-httpx/0.28.1" 2801822gitlab # [ 213.052974] nixbot[3169]: {"ts": "2026-07-12T13:13:51.809Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd2a84e64b1f23a1dc951887d4aadcf41e00be99 \"HTTP/1.1 201 Created\""}1823gitlab # [ 213.066258] nix-daemon[3495]: accepted connection from pid 3577, user nixbot1824gitlab # [ 213.082756] nix-daemon[3495]: accepted connection from pid 3582, user nixbot1825gitlab # [ 213.083907] gitaly[1404]: time="2026-07-12T13:13:51.840Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CWXKTA8MCR50C90DCDF9 diskcache=94f90fd7-9ed8-4fbe-bc0b-b8bb00541352 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-12T13:14:21.606" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:51.607" pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1826gitlab # [ 213.084990] gitaly[1404]: time="2026-07-12T13:13:51.840Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=185 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=6919 command.oublock=0 command.real_time_ms=222 command.spawn_token_fork_ms=1 command.system_time_ms=159 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CWXKTA8MCR50C90DCDF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-12T13:14:21.606" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:51.607" grpc.time_ms=232.639 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1827gitlab # [ 213.152675] gitaly[1404]: time="2026-07-12T13:13:51.908Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CWXKTA8MCR50C90DCDF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-12T13:14:21.807" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:51.907" grpc.time_ms=0.937 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1828gitlab # [ 213.179709] gitaly[1404]: time="2026-07-12T13:13:51.936Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CWXKTA8MCR50C90DCDF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:21.834" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:51.935" grpc.time_ms=0.733 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1829gitlab # [ 213.217354] gitaly[1404]: time="2026-07-12T13:13:51.973Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CWXKTA8MCR50C90DCDF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:21.871" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:51.972" grpc.time_ms=0.945 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1830gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4fecc7ad7664f93e37c7561aaf9789bb02b83fd9'1831gitlab # [ 213.254095] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.010Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"92bd237ac6850b4cfd5fa28f","created_at":"2026-07-12T13:13:52.004Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"ecaad12f11dc8baa193d0b79","job_size_bytes":3,"pid":2163,"job_status":"deduplicated","message":"PipelineProcessWorker JID-92bd237ac6850b4cfd5fa28f: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1832gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4fecc7ad7664f93e37c7561aaf9789bb02b83fd9', in 0.04 seconds)1833(finished: subtest: push delivers the webhook, in 4.17 seconds)1834subtest: eval and build post commit statuses1835gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses1836gitlab # [ 213.278472] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.015Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"ecaad12f11dc8baa193d0b79","created_at":"2026-07-12T13:13:51.493Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-5135e4456c034e94","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.497Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2163,"job_status":"rescheduled","message":"PipelineProcessWorker JID-ecaad12f11dc8baa193d0b79: rescheduled"}1837gitlab # [ 213.302330] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.026Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"ecaad12f11dc8baa193d0b79","created_at":"2026-07-12T13:13:51.493Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-5135e4456c034e94","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.497Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ecaad12f11dc8baa193d0b79: done: 0.526322 sec","job_status":"done","queue_duration_s":0.002314,"scheduling_latency_s":0.002368,"gitaly_calls":4,"gitaly_duration_s":0.245111,"redis_calls":104,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.048023,"redis_read_bytes":267,"redis_write_bytes":24006,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001439,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":17,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.002159,"redis_cache_read_bytes":33,"redis_cache_write_bytes":1526,"redis_feature_flag_calls":22,"redis_feature_flag_duration_s":0.006107,"redis_feature_flag_read_bytes":22,"redis_feature_flag_write_bytes":3871,"redis_queues_calls":22,"redis_queues_duration_s":0.00429,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12385,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.0091,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000216,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000646,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.022627,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":850,"db_count":47,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.031,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.034,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.173605,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.453399245,"duration_s":0.526322,"completed_at":"2026-07-12T13:13:52.026Z","load_balancing_strategy":"primary","db_duration_s":0.051806,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1838gitlab # [ 213.374204] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.029Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"a060b562ad8d778bc8b181c7","created_at":"2026-07-12T13:13:51.590Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.597Z","job_size_bytes":23,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-a060b562ad8d778bc8b181c7: start","job_status":"start","queue_duration_s":0.431439,"scheduling_latency_s":0.431487}1839gitlab # [ 213.375415] nixbot[3169]: INFO: ::ffff:127.0.0.1:55110 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 HTTP/1.1" 200 OK1840gitlab # [ 213.416244] gitaly[1404]: time="2026-07-12T13:13:52.172Z" level=info msg="finished unary call with code OK" catfile.duration_ms=56 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=56 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CXP935R0DNCFJQD6F499 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:22.114" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:52.114" grpc.time_ms=57.615 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1841gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses, in 0.16 seconds)1842gitlab # [ 213.449598] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1321843gitlab # [ 213.508268] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"a060b562ad8d778bc8b181c7","created_at":"2026-07-12T13:13:51.590Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.597Z","job_size_bytes":23,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-a060b562ad8d778bc8b181c7: done: 0.235041 sec","job_status":"done","queue_duration_s":0.431439,"scheduling_latency_s":0.431487,"redis_calls":15,"redis_duration_s":0.006877,"redis_read_bytes":13,"redis_write_bytes":3012,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002296,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_calls":2,"redis_queues_duration_s":0.000589,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1627,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00272,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":742,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000665,"redis_rate_limiting_write_bytes":148,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000607,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":13,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":13,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.119,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.118,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.093432,"worker_id":"sidekiq_0","rate_limiting_gates":["permanent_email_failure","temporary_email_failure"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000549511,"duration_s":0.235041,"completed_at":"2026-07-12T13:13:52.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.123407,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1844gitlab # [ 213.519883] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.266Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"c28b5f262efff430cb0a286f","created_at":"2026-07-12T13:13:52.254Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-d89c7525eb874ebe","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:a6bcfea86a7a6b29d806678ecd5190e4b0725044588ebecfc10ebc0234ea1939","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:52.256Z","job_size_bytes":464,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-c28b5f262efff430cb0a286f: start","job_status":"start","queue_duration_s":0.009901,"scheduling_latency_s":0.009922}1845gitlab # [ 213.553370] sidekiq-cluster[2163]: {"severity":"WARN","time":"2026-07-12T13:13:52.309Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"c28b5f262efff430cb0a286f","created_at":"2026-07-12T13:13:52.254Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-d89c7525eb874ebe","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:a6bcfea86a7a6b29d806678ecd5190e4b0725044588ebecfc10ebc0234ea1939","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:52.256Z","job_size_bytes":464,"pid":2163,"sidekiq_tid":"m2y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-c28b5f262efff430cb0a286f: fail: 0.042155 sec","job_status":"fail","queue_duration_s":0.009901,"scheduling_latency_s":0.009922,"redis_calls":7,"redis_duration_s":0.0030080000000000003,"redis_read_bytes":5,"redis_write_bytes":786,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002167,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000841,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042155,"completed_at":"2026-07-12T13:13:52.308Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/pipelines.rb:33:in `pipeline_mail'","app/mailers/emails/pipelines.rb:10:in `pipeline_failed_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.010315,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1846gitlab # [ 214.180536] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.311Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"fac79b23603cd46249e6542f","created_at":"2026-07-12T13:13:51.650Z","trace_propagation_headers":{"sentry-trace":"82c21b2415104afa8c6368115183ab88-4d714322eec441d9","baggage":"sentry-trace_id=82c21b2415104afa8c6368115183ab88,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CWX28ZMEBKEDPYXKN455","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.653Z","job_size_bytes":65,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-fac79b23603cd46249e6542f: start","job_status":"start","queue_duration_s":0.657992,"scheduling_latency_s":0.658019}1847gitlab # [ 214.181996] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.436Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"fac79b23603cd46249e6542f","created_at":"2026-07-12T13:13:51.650Z","trace_propagation_headers":{"sentry-trace":"82c21b2415104afa8c6368115183ab88-4d714322eec441d9","baggage":"sentry-trace_id=82c21b2415104afa8c6368115183ab88,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CWX28ZMEBKEDPYXKN455","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.653Z","job_size_bytes":65,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-fac79b23603cd46249e6542f: done: 0.124509 sec","job_status":"done","queue_duration_s":0.657992,"scheduling_latency_s":0.658019,"redis_calls":7,"redis_duration_s":0.0025009999999999998,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001872,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000629,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.101,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.101,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.124509,"completed_at":"2026-07-12T13:13:52.436Z","load_balancing_strategy":"primary","db_duration_s":0.101437,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1848gitlab # [ 214.272208] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.437Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2be6fee8e5db0fe7e9141f5a","created_at":"2026-07-12T13:13:51.655Z","trace_propagation_headers":{"sentry-trace":"82c21b2415104afa8c6368115183ab88-4d714322eec441d9","baggage":"sentry-trace_id=82c21b2415104afa8c6368115183ab88,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CWX28ZMEBKEDPYXKN455","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.658Z","job_size_bytes":65,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2be6fee8e5db0fe7e9141f5a: start","job_status":"start","queue_duration_s":0.77938,"scheduling_latency_s":0.779412}1849gitlab # [ 214.273363] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.479Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2be6fee8e5db0fe7e9141f5a","created_at":"2026-07-12T13:13:51.655Z","trace_propagation_headers":{"sentry-trace":"82c21b2415104afa8c6368115183ab88-4d714322eec441d9","baggage":"sentry-trace_id=82c21b2415104afa8c6368115183ab88,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CWX28ZMEBKEDPYXKN455","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.658Z","job_size_bytes":65,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2be6fee8e5db0fe7e9141f5a: done: 0.041371 sec","job_status":"done","queue_duration_s":0.77938,"scheduling_latency_s":0.779412,"redis_calls":10,"redis_duration_s":0.003057,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001235,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001822,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041371,"completed_at":"2026-07-12T13:13:52.479Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009723,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1850gitlab # [ 214.349044] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.480Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"767ca76144a569a5158effd6","created_at":"2026-07-12T13:13:51.697Z","trace_propagation_headers":{"sentry-trace":"82c21b2415104afa8c6368115183ab88-4d714322eec441d9","baggage":"sentry-trace_id=82c21b2415104afa8c6368115183ab88,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CWX28ZMEBKEDPYXKN455","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.700Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-767ca76144a569a5158effd6: start","job_status":"start","queue_duration_s":0.780536,"scheduling_latency_s":0.78056}1851gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses1852gitlab # [ 214.352946] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.591Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"767ca76144a569a5158effd6","created_at":"2026-07-12T13:13:51.697Z","trace_propagation_headers":{"sentry-trace":"82c21b2415104afa8c6368115183ab88-4d714322eec441d9","baggage":"sentry-trace_id=82c21b2415104afa8c6368115183ab88,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7CWX28ZMEBKEDPYXKN455","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.700Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-767ca76144a569a5158effd6: done: 0.111245 sec","job_status":"done","queue_duration_s":0.780536,"scheduling_latency_s":0.78056,"gitaly_calls":3,"gitaly_duration_s":0.009134,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.008116,"redis_read_bytes":99,"redis_write_bytes":6014,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001013,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.002256,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.000301,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001704,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000247,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000507,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001075,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":31,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":31,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":19,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076983,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.090758183,"duration_s":0.111245,"completed_at":"2026-07-12T13:13:52.591Z","load_balancing_strategy":"primary","db_duration_s":0.024075,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1853gitlab # [ 214.493962] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.593Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0a56dac9ebb29b4c3d698b3d","created_at":"2026-07-12T13:13:51.846Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.851Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0a56dac9ebb29b4c3d698b3d: start","job_status":"start","queue_duration_s":0.741843,"scheduling_latency_s":0.741865}1854gitlab # [ 214.495236] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.618Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0a56dac9ebb29b4c3d698b3d","created_at":"2026-07-12T13:13:51.846Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.851Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0a56dac9ebb29b4c3d698b3d: done: 0.02457 sec","job_status":"done","queue_duration_s":0.741843,"scheduling_latency_s":0.741865,"redis_calls":10,"redis_duration_s":0.002389,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000491,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001462,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000436,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000347809,"duration_s":0.02457,"completed_at":"2026-07-12T13:13:52.617Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002848,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1855gitlab # [ 214.584476] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.619Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"b8e1d495d0251f39d445c566","created_at":"2026-07-12T13:13:51.866Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.870Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-b8e1d495d0251f39d445c566: start","job_status":"start","queue_duration_s":0.748575,"scheduling_latency_s":0.748595}1856gitlab # [ 214.585867] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.731Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"b8e1d495d0251f39d445c566","created_at":"2026-07-12T13:13:51.866Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.870Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-b8e1d495d0251f39d445c566: done: 0.111541 sec","job_status":"done","queue_duration_s":0.748575,"scheduling_latency_s":0.748595,"redis_calls":10,"redis_duration_s":0.00329,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000569,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001921,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0008,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.071,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.071,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000783899,"duration_s":0.111541,"completed_at":"2026-07-12T13:13:52.730Z","load_balancing_strategy":"primary","db_duration_s":0.071116,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1857gitlab # [ 214.654311] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.734Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2b79c4a9cbb65845316bdd53","created_at":"2026-07-12T13:13:51.882Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.885Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2b79c4a9cbb65845316bdd53: start","job_status":"start","queue_duration_s":0.848507,"scheduling_latency_s":0.848549}1858gitlab # [ 214.655709] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.768Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2b79c4a9cbb65845316bdd53","created_at":"2026-07-12T13:13:51.882Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.885Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2b79c4a9cbb65845316bdd53: done: 0.034147 sec","job_status":"done","queue_duration_s":0.848507,"scheduling_latency_s":0.848549,"redis_calls":13,"redis_duration_s":0.0033569999999999997,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000438,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001416,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000735,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000768,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000374349,"duration_s":0.034147,"completed_at":"2026-07-12T13:13:52.768Z","load_balancing_strategy":"primary","db_duration_s":0.003392,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1859gitlab # [ 214.735095] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.769Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4dcf1888a9141f096137f04e","created_at":"2026-07-12T13:13:51.886Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.889Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4dcf1888a9141f096137f04e: start","job_status":"start","queue_duration_s":0.879865,"scheduling_latency_s":0.879886}1860gitlab # [ 214.736333] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.793Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4dcf1888a9141f096137f04e","created_at":"2026-07-12T13:13:51.886Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.889Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4dcf1888a9141f096137f04e: done: 0.023664 sec","job_status":"done","queue_duration_s":0.879865,"scheduling_latency_s":0.879886,"redis_calls":10,"redis_duration_s":0.002316,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001385,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000451,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035619,"duration_s":0.023664,"completed_at":"2026-07-12T13:13:52.793Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002984,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1861gitlab # [ 214.815463] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.794Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c72a364816660df806ddf189","created_at":"2026-07-12T13:13:51.890Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.893Z","job_size_bytes":19,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c72a364816660df806ddf189: start","job_status":"start","queue_duration_s":0.900631,"scheduling_latency_s":0.900653}1862gitlab # [ 214.831354] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.823Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c72a364816660df806ddf189","created_at":"2026-07-12T13:13:51.890Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.893Z","job_size_bytes":19,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c72a364816660df806ddf189: done: 0.028437 sec","job_status":"done","queue_duration_s":0.900631,"scheduling_latency_s":0.900653,"redis_calls":11,"redis_duration_s":0.003303,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000437,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001856,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00101,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000371277,"duration_s":0.028437,"completed_at":"2026-07-12T13:13:52.822Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002777,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1863gitlab # [ 214.900160] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.824Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"322e539056b016fc7a97dfad","created_at":"2026-07-12T13:13:51.896Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.900Z","job_size_bytes":65,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-322e539056b016fc7a97dfad: start","job_status":"start","queue_duration_s":0.924583,"scheduling_latency_s":0.924605}1864gitlab # [ 214.972667] gitaly[1404]: time="2026-07-12T13:13:52.534Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CWX28ZMEBKEDPYXKN455 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-12T13:14:22.532" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:52.533" grpc.time_ms=0.943 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1865gitlab # [ 214.974419] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.850Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"322e539056b016fc7a97dfad","created_at":"2026-07-12T13:13:51.896Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.900Z","job_size_bytes":65,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-322e539056b016fc7a97dfad: done: 0.026266 sec","job_status":"done","queue_duration_s":0.924583,"scheduling_latency_s":0.924605,"redis_calls":10,"redis_duration_s":0.002317,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000467,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001385,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000465,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000381333,"duration_s":0.026266,"completed_at":"2026-07-12T13:13:52.850Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00301,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1866gitlab # [ 215.045388] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.852Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"e0fde0b85003bb1e3a8e715e","created_at":"2026-07-12T13:13:51.901Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.902Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-e0fde0b85003bb1e3a8e715e: start","job_status":"start","queue_duration_s":0.950059,"scheduling_latency_s":0.95008}1867gitlab # [ 215.046877] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.877Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"e0fde0b85003bb1e3a8e715e","created_at":"2026-07-12T13:13:51.901Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.902Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-e0fde0b85003bb1e3a8e715e: done: 0.025431 sec","job_status":"done","queue_duration_s":0.950059,"scheduling_latency_s":0.95008,"redis_calls":7,"redis_duration_s":0.001671,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001228,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000443,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025431,"completed_at":"2026-07-12T13:13:52.877Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003752,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1868gitlab # [ 215.134452] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.879Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"8f4dd2abc17690e8811bd2c4","created_at":"2026-07-12T13:13:51.937Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.941Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-8f4dd2abc17690e8811bd2c4: start","job_status":"start","queue_duration_s":0.937497,"scheduling_latency_s":0.937521}1869gitlab # [ 215.136226] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.908Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"8f4dd2abc17690e8811bd2c4","created_at":"2026-07-12T13:13:51.937Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.941Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-8f4dd2abc17690e8811bd2c4: done: 0.028886 sec","job_status":"done","queue_duration_s":0.937497,"scheduling_latency_s":0.937521,"redis_calls":10,"redis_duration_s":0.002427,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000482,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001408,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000537,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000357867,"duration_s":0.028886,"completed_at":"2026-07-12T13:13:52.907Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006977,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1870gitlab # [ 215.210885] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.909Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"9c9e80aed671323f5f358ab8","created_at":"2026-07-12T13:13:51.942Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.946Z","job_size_bytes":6,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-9c9e80aed671323f5f358ab8: start","job_status":"start","queue_duration_s":0.962869,"scheduling_latency_s":0.962889}1871gitlab # [ 215.278155] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.930Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"9c9e80aed671323f5f358ab8","created_at":"2026-07-12T13:13:51.942Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:51.946Z","job_size_bytes":6,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-9c9e80aed671323f5f358ab8: done: 0.020577 sec","job_status":"done","queue_duration_s":0.962869,"scheduling_latency_s":0.962889,"redis_calls":10,"redis_duration_s":0.002288,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000445,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001381,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000341943,"duration_s":0.020577,"completed_at":"2026-07-12T13:13:52.929Z","load_balancing_strategy":"primary","db_duration_s":0.001731,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1872gitlab # [ 215.291460] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:52.931Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"5f3b9f3581c51e5920ad6456","created_at":"2026-07-12T13:13:52.015Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:52.018Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5f3b9f3581c51e5920ad6456: start","job_status":"start","queue_duration_s":0.913005,"scheduling_latency_s":0.913025}1873gitlab # [ 215.368363] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:53.003Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"5f3b9f3581c51e5920ad6456","created_at":"2026-07-12T13:13:52.015Z","trace_propagation_headers":{"sentry-trace":"dbca2e2db1e145d689733a157d752acc-cd6f61f4903f4505","baggage":"sentry-trace_id=dbca2e2db1e145d689733a157d752acc,sentry-release=Unknown"},"correlation_id":"01KXB7CWXKTA8MCR50C90DCDF9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:52.018Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5f3b9f3581c51e5920ad6456: done: 0.071746 sec","job_status":"done","queue_duration_s":0.913005,"scheduling_latency_s":0.913025,"gitaly_calls":2,"gitaly_duration_s":0.006643,"redis_calls":19,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.003739,"redis_read_bytes":42,"redis_write_bytes":1891,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000702,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001517,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000226,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001294,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":20,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":20,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":9,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.048115333,"duration_s":0.071746,"completed_at":"2026-07-12T13:13:53.003Z","load_balancing_strategy":"primary","db_duration_s":0.013501,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1874gitlab # [ 215.389218] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:53.005Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"e7084f982ad180011d639d95","created_at":"2026-07-12T13:13:52.522Z","trace_propagation_headers":{"sentry-trace":"82c21b2415104afa8c6368115183ab88-0a776ead72094c69","baggage":"sentry-trace_id=82c21b2415104afa8c6368115183ab88,sentry-release=Unknown"},"correlation_id":"01KXB7CWX28ZMEBKEDPYXKN455","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:52.524Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-e7084f982ad180011d639d95: start","job_status":"start","queue_duration_s":0.481009,"scheduling_latency_s":0.481034}1875gitlab # [ 215.461460] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:53.031Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"e7084f982ad180011d639d95","created_at":"2026-07-12T13:13:52.522Z","trace_propagation_headers":{"sentry-trace":"82c21b2415104afa8c6368115183ab88-0a776ead72094c69","baggage":"sentry-trace_id=82c21b2415104afa8c6368115183ab88,sentry-release=Unknown"},"correlation_id":"01KXB7CWX28ZMEBKEDPYXKN455","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:52.524Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-e7084f982ad180011d639d95: done: 0.025983 sec","job_status":"done","queue_duration_s":0.481009,"scheduling_latency_s":0.481034,"redis_calls":7,"redis_duration_s":0.001719,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001231,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000488,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025983,"completed_at":"2026-07-12T13:13:53.031Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1876gitlab # [ 215.530829] gitaly[1404]: time="2026-07-12T13:13:52.560Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CWX28ZMEBKEDPYXKN455 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:22.559" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:52.559" grpc.time_ms=0.65 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877gitlab # [ 215.532495] gitaly[1404]: time="2026-07-12T13:13:52.582Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CWX28ZMEBKEDPYXKN455 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:22.581" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:52.581" grpc.time_ms=0.749 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1878gitlab # [ 215.534456] gitaly[1404]: time="2026-07-12T13:13:52.964Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7CWXKTA8MCR50C90DCDF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-12T13:14:22.862" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:52.963" grpc.time_ms=0.795 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1879gitlab # [ 215.537412] gitaly[1404]: time="2026-07-12T13:13:52.989Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CWXKTA8MCR50C90DCDF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:22.888" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:52.988" grpc.time_ms=0.766 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1880gitlab # [ 215.559380] gitaly[1404]: time="2026-07-12T13:13:53.283Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7CYTT590M6BW7HD2N1F1X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:23.282" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:53.283" grpc.time_ms=0.649 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1881gitlab # [ 215.673701] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 11841882gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses, in 1.23 seconds)1883gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses1884gitlab # [ 216.808874] gitaly[1404]: time="2026-07-12T13:13:55.564Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D10YK5PE032N8T3A2G9X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:25.561" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:55.562" grpc.time_ms=1.451 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1885gitlab # [ 216.837443] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1051886gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses, in 0.18 seconds)1887gitlab # [ 217.808934] nix-daemon[3495]: accepted connection from pid 3615, user nixbot1888gitlab # [ 217.842912] gitaly[1404]: time="2026-07-12T13:13:56.598Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D2259G6TK10CHKADP1AX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:26.596" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:56.597" grpc.time_ms=0.792 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1889gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses1890gitlab # [ 217.881485] gitaly[1404]: time="2026-07-12T13:13:56.637Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KXB7D2259G6TK10CHKADP1AX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-12T13:14:06.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:56.623" grpc.time_ms=14.099 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1891gitlab # [ 217.933550] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:56.689Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"98940dac8b24b86d8c1cdfb4","created_at":"2026-07-12T13:13:56.676Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-2e11ed737190487f","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:56.680Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-98940dac8b24b86d8c1cdfb4: start","job_status":"start","queue_duration_s":0.008833,"scheduling_latency_s":0.008874}1892gitlab # [ 217.959337] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 1651893gitlab # [ 217.960765] nixbot[3169]: {"ts": "2026-07-12T13:13:56.716Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 \"HTTP/1.1 201 Created\""}1894gitlab # [ 217.969225] gitaly[1404]: time="2026-07-12T13:13:56.725Z" level=info msg="finished unary call with code OK" catfile.duration_ms=4 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=4 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D25M722RDBXM0X25P31E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:26.211" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:56.711" grpc.time_ms=13.117 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1895gitlab # [ 218.006462] gitaly[1404]: time="2026-07-12T13:13:56.763Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D27J6TRT3MBDQSSSPVGB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:26.761" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:56.762" grpc.time_ms=0.851 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1896gitlab # [ 218.024120] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses HTTP/1.1" 200 671 "" "curl/8.20.0" 1171897gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses, in 0.17 seconds)1898gitlab # [ 218.041254] gitaly[1404]: time="2026-07-12T13:13:56.797Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7D27J6TRT3MBDQSSSPVGB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-12T13:14:06.138" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:56.789" grpc.time_ms=8.624 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1899gitlab # [ 218.084105] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1171900gitlab # [ 218.088762] nixbot[3169]: {"ts": "2026-07-12T13:13:56.840Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 \"HTTP/1.1 201 Created\""}1901gitlab # [ 218.104728] gitaly[1404]: time="2026-07-12T13:13:56.861Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7D2259G6TK10CHKADP1AX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:56.860" grpc.time_ms=0.616 pid=1404 span.kind=server system=grpc1902gitlab # [ 218.152271] gitaly[1404]: time="2026-07-12T13:13:56.908Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7D2259G6TK10CHKADP1AX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:56.908" grpc.time_ms=0.463 pid=1404 span.kind=server system=grpc1903gitlab # [ 218.191269] gitaly[1404]: time="2026-07-12T13:13:56.947Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7D2259G6TK10CHKADP1AX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:13:56.947" grpc.time_ms=0.436 pid=1404 span.kind=server system=grpc1904gitlab # [ 218.216760] gitaly[1404]: time="2026-07-12T13:13:56.973Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D2259G6TK10CHKADP1AX diskcache=ea39a4b3-73c5-4aaa-9016-bc443c70c148 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-12T13:14:26.826" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:56.826" pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1905gitlab # [ 218.217984] gitaly[1404]: time="2026-07-12T13:13:56.973Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=143 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7100 command.oublock=0 command.real_time_ms=139 command.spawn_token_fork_ms=0 command.system_time_ms=103 command.user_time_ms=40 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D2259G6TK10CHKADP1AX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-12T13:14:26.826" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:13:56.826" grpc.time_ms=146.553 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1906gitlab # [ 218.284836] gitaly[1404]: time="2026-07-12T13:13:57.041Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7D2259G6TK10CHKADP1AX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-12T13:14:27.039" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:57.040" grpc.time_ms=1.026 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1907gitlab # [ 218.343083] gitaly[1404]: time="2026-07-12T13:13:57.099Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D2259G6TK10CHKADP1AX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:27.097" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:57.098" grpc.time_ms=1.044 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1908gitlab # [ 218.469524] gitaly[1404]: time="2026-07-12T13:13:57.225Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D2259G6TK10CHKADP1AX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:27.222" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:57.224" grpc.time_ms=1.438 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1909gitlab # [ 218.543799] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:57.299Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"fc3bab4cebec18900f2c27d6","created_at":"2026-07-12T13:13:57.289Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"98940dac8b24b86d8c1cdfb4","job_size_bytes":3,"pid":2163,"job_status":"deduplicated","message":"PipelineProcessWorker JID-fc3bab4cebec18900f2c27d6: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1910gitlab # [ 218.585764] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:57.341Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"98940dac8b24b86d8c1cdfb4","created_at":"2026-07-12T13:13:56.676Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-2e11ed737190487f","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:56.680Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2163,"job_status":"rescheduled","message":"PipelineProcessWorker JID-98940dac8b24b86d8c1cdfb4: rescheduled"}1911gitlab # [ 218.620331] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:57.375Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"98940dac8b24b86d8c1cdfb4","created_at":"2026-07-12T13:13:56.676Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-2e11ed737190487f","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:56.680Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-98940dac8b24b86d8c1cdfb4: done: 0.686702 sec","job_status":"done","queue_duration_s":0.008833,"scheduling_latency_s":0.008874,"gitaly_calls":4,"gitaly_duration_s":0.245629,"redis_calls":93,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.123009,"redis_read_bytes":262,"redis_write_bytes":23381,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002779,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.008086,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.010042,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":712,"redis_queues_calls":25,"redis_queues_duration_s":0.020741,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14462,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.065121,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.002614,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002689,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.008158,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":38,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":38,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.106,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":23,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.01,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.014,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.057,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.174091,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.53759598,"duration_s":0.686702,"completed_at":"2026-07-12T13:13:57.375Z","load_balancing_strategy":"primary","db_duration_s":0.114851,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1912gitlab # [ 218.715144] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:57.470Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"be57d7976fbb631f96055778","created_at":"2026-07-12T13:13:56.815Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:56.818Z","job_size_bytes":23,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-be57d7976fbb631f96055778: start","job_status":"start","queue_duration_s":0.651891,"scheduling_latency_s":0.651964}1913gitlab # [ 218.858753] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:57.614Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"be57d7976fbb631f96055778","created_at":"2026-07-12T13:13:56.815Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:56.818Z","job_size_bytes":23,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-be57d7976fbb631f96055778: done: 0.143833 sec","job_status":"done","queue_duration_s":0.651891,"scheduling_latency_s":0.651964,"redis_calls":7,"redis_duration_s":0.017674000000000002,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011388,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006286,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.143833,"completed_at":"2026-07-12T13:13:57.614Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028967,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1914gitlab # [ 218.964708] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:57.719Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a18d05a8fcbe677ee68be07c","created_at":"2026-07-12T13:13:56.980Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:56.983Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a18d05a8fcbe677ee68be07c: start","job_status":"start","queue_duration_s":0.736053,"scheduling_latency_s":0.736137}1915gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses1916gitlab # [ 219.057542] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:57.813Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a18d05a8fcbe677ee68be07c","created_at":"2026-07-12T13:13:56.980Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:56.983Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a18d05a8fcbe677ee68be07c: done: 0.094253 sec","job_status":"done","queue_duration_s":0.736053,"scheduling_latency_s":0.736137,"redis_calls":7,"redis_duration_s":0.011602,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009403,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002199,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.094253,"completed_at":"2026-07-12T13:13:57.813Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008751,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1917gitlab # [ 219.093348] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:57.822Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"003827e94cd166f4fc093e0e","created_at":"2026-07-12T13:13:56.997Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.001Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-003827e94cd166f4fc093e0e: start","job_status":"start","queue_duration_s":0.820932,"scheduling_latency_s":0.821002}1918gitlab # [ 219.124659] gitaly[1404]: time="2026-07-12T13:13:57.878Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D3A6MHRW33MC9VSD9TEQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:27.076" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:57.877" grpc.time_ms=1.209 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1919gitlab # [ 219.189571] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 1141920gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses, in 0.16 seconds)1921gitlab # [ 219.280387] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:58.035Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"003827e94cd166f4fc093e0e","created_at":"2026-07-12T13:13:56.997Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.001Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-003827e94cd166f4fc093e0e: done: 0.213092 sec","job_status":"done","queue_duration_s":0.820932,"scheduling_latency_s":0.821002,"redis_calls":7,"redis_duration_s":0.088642,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008547,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.080095,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.063,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.063,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.213092,"completed_at":"2026-07-12T13:13:58.035Z","load_balancing_strategy":"primary","db_duration_s":0.062919,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1922gitlab # [ 219.378136] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:58.134Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"a9a9c3790e139ea0eebd4595","created_at":"2026-07-12T13:13:57.011Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.014Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a9a9c3790e139ea0eebd4595: start","job_status":"start","queue_duration_s":1.119632,"scheduling_latency_s":1.11968}1923gitlab # [ 219.484576] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:58.240Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"a9a9c3790e139ea0eebd4595","created_at":"2026-07-12T13:13:57.011Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.014Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a9a9c3790e139ea0eebd4595: done: 0.106439 sec","job_status":"done","queue_duration_s":1.119632,"scheduling_latency_s":1.11968,"redis_calls":10,"redis_duration_s":0.026820999999999998,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011016,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.009711,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006094,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.106439,"completed_at":"2026-07-12T13:13:58.240Z","load_balancing_strategy":"primary","db_duration_s":0.013967,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1924gitlab # [ 219.582212] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:58.338Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4db433c80f79e2ae0d7ae318","created_at":"2026-07-12T13:13:57.015Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.017Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4db433c80f79e2ae0d7ae318: start","job_status":"start","queue_duration_s":1.320185,"scheduling_latency_s":1.32026}1925gitlab # [ 219.677918] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:58.433Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4db433c80f79e2ae0d7ae318","created_at":"2026-07-12T13:13:57.015Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.017Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4db433c80f79e2ae0d7ae318: done: 0.095706 sec","job_status":"done","queue_duration_s":1.320185,"scheduling_latency_s":1.32026,"redis_calls":7,"redis_duration_s":0.019093,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.015086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004007,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.095706,"completed_at":"2026-07-12T13:13:58.433Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1926gitlab # [ 219.769283] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:58.525Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"93d4940a24e78b407fa9f6bc","created_at":"2026-07-12T13:13:57.019Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.023Z","job_size_bytes":19,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-93d4940a24e78b407fa9f6bc: start","job_status":"start","queue_duration_s":1.501786,"scheduling_latency_s":1.501865}1927gitlab # [ 219.874165] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:58.628Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"93d4940a24e78b407fa9f6bc","created_at":"2026-07-12T13:13:57.019Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.023Z","job_size_bytes":19,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-93d4940a24e78b407fa9f6bc: done: 0.103908 sec","job_status":"done","queue_duration_s":1.501786,"scheduling_latency_s":1.501865,"redis_calls":8,"redis_duration_s":0.021348,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.014095,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.007253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035074,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.103908,"completed_at":"2026-07-12T13:13:58.628Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00756,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1928gitlab # [ 219.976224] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:58.731Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"d19a7185c872a40189cde464","created_at":"2026-07-12T13:13:57.024Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.027Z","job_size_bytes":66,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-d19a7185c872a40189cde464: start","job_status":"start","queue_duration_s":1.703741,"scheduling_latency_s":1.703816}1929gitlab # [ 220.072557] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:58.828Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"d19a7185c872a40189cde464","created_at":"2026-07-12T13:13:57.024Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.027Z","job_size_bytes":66,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-d19a7185c872a40189cde464: done: 0.09732 sec","job_status":"done","queue_duration_s":1.703741,"scheduling_latency_s":1.703816,"redis_calls":7,"redis_duration_s":0.01633,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005628,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.09732,"completed_at":"2026-07-12T13:13:58.828Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006669,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1930gitlab # [ 220.167142] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:58.921Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"73c89bea9f63dd63254e6337","created_at":"2026-07-12T13:13:57.030Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.033Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-73c89bea9f63dd63254e6337: start","job_status":"start","queue_duration_s":1.88809,"scheduling_latency_s":1.888177}1931gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses1932gitlab # [ 220.256677] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:59.012Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"73c89bea9f63dd63254e6337","created_at":"2026-07-12T13:13:57.030Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.033Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-73c89bea9f63dd63254e6337: done: 0.091742 sec","job_status":"done","queue_duration_s":1.88809,"scheduling_latency_s":1.888177,"redis_calls":7,"redis_duration_s":0.008374,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006859,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001515,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.091742,"completed_at":"2026-07-12T13:13:59.012Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012155,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1933gitlab # [ 220.274152] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:59.029Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"29ad1d02ee00680761ee30ec","created_at":"2026-07-12T13:13:57.138Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.143Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-29ad1d02ee00680761ee30ec: start","job_status":"start","queue_duration_s":1.885407,"scheduling_latency_s":1.885481}1934gitlab # [ 220.338582] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:59.094Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"29ad1d02ee00680761ee30ec","created_at":"2026-07-12T13:13:57.138Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.143Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-29ad1d02ee00680761ee30ec: done: 0.065608 sec","job_status":"done","queue_duration_s":1.885407,"scheduling_latency_s":1.885481,"redis_calls":7,"redis_duration_s":0.01768,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004862,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.065608,"completed_at":"2026-07-12T13:13:59.094Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01188,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1935gitlab # [ 220.352087] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:59.107Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"94ea9aca6679190f9dc82418","created_at":"2026-07-12T13:13:57.146Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.151Z","job_size_bytes":6,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-94ea9aca6679190f9dc82418: start","job_status":"start","queue_duration_s":1.956121,"scheduling_latency_s":1.956183}1936gitlab # [ 220.430186] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:59.149Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"94ea9aca6679190f9dc82418","created_at":"2026-07-12T13:13:57.146Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.151Z","job_size_bytes":6,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-94ea9aca6679190f9dc82418: done: 0.042056 sec","job_status":"done","queue_duration_s":1.956121,"scheduling_latency_s":1.956183,"redis_calls":7,"redis_duration_s":0.006642,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004299,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002343,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042056,"completed_at":"2026-07-12T13:13:59.149Z","load_balancing_strategy":"primary","db_duration_s":0.001665,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1937gitlab # [ 220.435702] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:59.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"7264127ef56fca24563e32dd","created_at":"2026-07-12T13:13:57.153Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.166Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-7264127ef56fca24563e32dd: start","job_status":"start","queue_duration_s":1.986772,"scheduling_latency_s":1.986808}1938gitlab # [ 220.530402] gitaly[1404]: time="2026-07-12T13:13:59.285Z" level=info msg="finished unary call with code OK" catfile.duration_ms=104 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=104 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D4EK4YXT9JBR6W0BEMKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:29.079" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:59.179" grpc.time_ms=105.347 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939gitlab # [ 220.569042] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:59.325Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"7264127ef56fca24563e32dd","created_at":"2026-07-12T13:13:57.153Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.166Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-7264127ef56fca24563e32dd: done: 0.172515 sec","job_status":"done","queue_duration_s":1.986772,"scheduling_latency_s":1.986808,"redis_calls":10,"redis_duration_s":0.016633000000000002,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002118,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011986,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002529,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.096,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.068,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00264894,"duration_s":0.172515,"completed_at":"2026-07-12T13:13:59.325Z","load_balancing_strategy":"primary","db_duration_s":0.101868,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1940gitlab # [ 220.580140] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:59.335Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"5857765838648adfd8f60bc7","created_at":"2026-07-12T13:13:57.345Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.351Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5857765838648adfd8f60bc7: start","job_status":"start","queue_duration_s":1.983858,"scheduling_latency_s":1.983891}1941gitlab # [ 220.649604] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:13:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 3391942gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses, in 0.47 seconds)1943gitlab # [ 220.741407] gitaly[1404]: time="2026-07-12T13:13:59.497Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7D2259G6TK10CHKADP1AX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-12T13:14:29.495" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:59.496" grpc.time_ms=1.52 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1944gitlab # [ 220.796952] gitaly[1404]: time="2026-07-12T13:13:59.553Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D2259G6TK10CHKADP1AX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:29.551" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:59.552" grpc.time_ms=0.931 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1945gitlab # [ 220.898656] gitaly[1404]: time="2026-07-12T13:13:59.655Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D2259G6TK10CHKADP1AX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:29.651" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:13:59.652" grpc.time_ms=1.791 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1946gitlab # [ 221.089828] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:59.845Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"5857765838648adfd8f60bc7","created_at":"2026-07-12T13:13:57.345Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-c53f18d585d74478","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:57.351Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5857765838648adfd8f60bc7: done: 0.509674 sec","job_status":"done","queue_duration_s":1.983858,"scheduling_latency_s":1.983891,"gitaly_calls":3,"gitaly_duration_s":0.048924,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.181779,"redis_read_bytes":98,"redis_write_bytes":6012,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.004054,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.117566,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.000481,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1131,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.012302,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000474,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.005979,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.036869,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.1,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":20,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.01,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.05,"db_ci_duration_s":0.049,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.136799,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.371888606,"duration_s":0.509674,"completed_at":"2026-07-12T13:13:59.844Z","load_balancing_strategy":"primary","db_duration_s":0.106599,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1947gitlab # [ 221.210827] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:13:59.966Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a65b95ee08d2d6902d906cfa","created_at":"2026-07-12T13:13:59.476Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-35e7184f7630473b","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:59.480Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a65b95ee08d2d6902d906cfa: start","job_status":"start","queue_duration_s":0.486417,"scheduling_latency_s":0.486502}1948gitlab # [ 221.320009] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:14:00.075Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a65b95ee08d2d6902d906cfa","created_at":"2026-07-12T13:13:59.476Z","trace_propagation_headers":{"sentry-trace":"befe05b9a836450b9906d1a7f0ac816d-35e7184f7630473b","baggage":"sentry-trace_id=befe05b9a836450b9906d1a7f0ac816d,sentry-release=Unknown"},"correlation_id":"01KXB7D2259G6TK10CHKADP1AX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-12T13:13:59.480Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a65b95ee08d2d6902d906cfa: done: 0.109205 sec","job_status":"done","queue_duration_s":0.486417,"scheduling_latency_s":0.486502,"redis_calls":7,"redis_duration_s":0.01676,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01274,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00402,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.109205,"completed_at":"2026-07-12T13:14:00.075Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014664,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1949gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses1950gitlab # [ 221.765964] gitaly[1404]: time="2026-07-12T13:14:00.522Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D5WGSCYHQQVT3PAJQQ3N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:30.419" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:14:00.520" grpc.time_ms=1.501 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1951gitlab # [ 221.795975] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:14:00 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 851952gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses, in 0.14 seconds)1953gitlab # [ 222.417193] nix-daemon[3495]: accepted connection from pid 3694, user nixbot1954gitlab # [ 222.512237] gitaly[1404]: time="2026-07-12T13:14:01.268Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D6KYZGV5BBWTHZ9HCC1M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:31.265" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:14:01.266" grpc.time_ms=1.487 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1955gitlab # [ 222.605213] gitaly[1404]: time="2026-07-12T13:14:01.361Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KXB7D6KYZGV5BBWTHZ9HCC1M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-12T13:14:11.025" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:14:01.345" grpc.time_ms=15.432 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1956gitlab # [ 222.672629] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:14:01.427Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"666895684de7a398abe1db15","created_at":"2026-07-12T13:14:01.413Z","trace_propagation_headers":{"sentry-trace":"80521b86dd75489ca9e791186bb7e537-724ad00055fc4b57","baggage":"sentry-trace_id=80521b86dd75489ca9e791186bb7e537,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7D6KYZGV5BBWTHZ9HCC1M","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-12T13:14:01.420Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-666895684de7a398abe1db15: start","job_status":"start","queue_duration_s":0.007462,"scheduling_latency_s":0.00754}1957gitlab # [ 222.706183] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:14:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2271958gitlab # [ 222.707652] nixbot[3169]: {"ts": "2026-07-12T13:14:01.448Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9 \"HTTP/1.1 201 Created\""}1959gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses1960gitlab # [ 222.837342] gitaly[1404]: time="2026-07-12T13:14:01.593Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7D6KYZGV5BBWTHZ9HCC1M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:14:01.592" grpc.time_ms=0.532 pid=1404 span.kind=server system=grpc1961gitlab # [ 222.896418] gitaly[1404]: time="2026-07-12T13:14:01.653Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7D6KYZGV5BBWTHZ9HCC1M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:14:01.652" grpc.time_ms=0.525 pid=1404 span.kind=server system=grpc1962gitlab # [ 222.901397] gitaly[1404]: time="2026-07-12T13:14:01.657Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D7053NYTXNZN7GRJ8W6E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:31.555" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:14:01.655" grpc.time_ms=1.287 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1963gitlab # [ 222.906333] nix-daemon[3495]: accepted connection from pid 3724, user nixbot1964gitlab # [ 222.958874] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:14:01 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses HTTP/1.1" 200 1328 "" "curl/8.20.0" 1081965gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4fecc7ad7664f93e37c7561aaf9789bb02b83fd9/statuses, in 0.15 seconds)1966(finished: subtest: eval and build post commit statuses, in 9.67 seconds)1967(finished: run the VM test script, in 265.02 seconds)1968gitlab # [ 222.966224] gitaly[1404]: time="2026-07-12T13:14:01.722Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KXB7D6KYZGV5BBWTHZ9HCC1M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-12T13:14:01.722" grpc.time_ms=0.365 pid=1404 span.kind=server system=grpc1969gitlab # [ 222.985418] gitaly[1404]: time="2026-07-12T13:14:01.741Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D6KYZGV5BBWTHZ9HCC1M forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-12T13:14:31.549" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:14:01.549" operations="[repack_refs]" pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1970gitlab # [ 223.002661] gitaly[1404]: time="2026-07-12T13:14:01.743Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D6KYZGV5BBWTHZ9HCC1M grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-12T13:14:31.549" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:14:01.549" pid=1404 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-07-12 13:13:40.538532528 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root1971gitlab # [ 223.006859] gitaly[1404]: time="2026-07-12T13:14:01.763Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D6KYZGV5BBWTHZ9HCC1M diskcache=d726b9fa-cfd2-423d-9824-697e8e6e0689 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-12T13:14:31.549" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:14:01.549" pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1972gitlab # [ 223.008231] gitaly[1404]: time="2026-07-12T13:14:01.763Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=161 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7363 command.oublock=0 command.real_time_ms=190 command.spawn_token_fork_ms=1 command.system_time_ms=124 command.user_time_ms=37 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D6KYZGV5BBWTHZ9HCC1M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-12T13:14:31.549" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:14:01.549" grpc.time_ms=213.9 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1973gitlab # [ 223.062945] gitaly[1404]: time="2026-07-12T13:14:01.819Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D6KYZGV5BBWTHZ9HCC1M grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-12T13:14:31.549" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:14:01.549" pid=1404 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root1974gitlab # [ 223.068209] gitaly[1404]: time="2026-07-12T13:14:01.822Z" level=info msg="optimized repository" clean_stale_data_time=59.56148ms clean_work_trees_time=2.480763ms commit_graph_time="8.661µs" correlation_id=01KXB7D6KYZGV5BBWTHZ9HCC1M gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="8.381µs" pid=1404 prune_time="8.102µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="19.556µs" storage_name=default system=housekeeping total_time=62.319652ms1975gitlab # [ 223.068993] gitaly[1404]: time="2026-07-12T13:14:01.822Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D6KYZGV5BBWTHZ9HCC1M grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-12T13:14:31.549" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-12T13:14:01.549" pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1976gitlab # [ 223.085133] gitaly[1404]: time="2026-07-12T13:14:01.840Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KXB7D75MFKS5FMWYCEQ2D0FY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:14:01.828" grpc.time_ms=11.884 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1977gitlab # [ 223.086423] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:14:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 601978gitlab # [ 223.087324] gitaly[1404]: time="2026-07-12T13:14:01.843Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KXB7D6KYZGV5BBWTHZ9HCC1M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-12T13:14:31.842" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:14:01.842" grpc.time_ms=0.846 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1979gitlab # [ 223.115481] gitaly[1404]: time="2026-07-12T13:14:01.872Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D6KYZGV5BBWTHZ9HCC1M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:31.869" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:14:01.870" grpc.time_ms=1.026 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1980gitlab # [ 223.158135] gitaly[1404]: time="2026-07-12T13:14:01.914Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D77PHM28Q58689K5TQFM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:14:01.900" pid=1404 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1981gitlab # [ 223.160107] gitaly[1404]: time="2026-07-12T13:14:01.914Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D77PHM28Q58689K5TQFM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:14:01.900" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1982gitlab # [ 223.161082] gitaly[1404]: time="2026-07-12T13:14:01.914Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D77PHM28Q58689K5TQFM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-12T13:14:01.900" grpc.time_ms=14.271 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc1983gitlab # [ 223.162167] gitlab-workhorse[1305]: time="2026-07-12T13:14:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671984gitlab # [ 223.164353] gitlab-workhorse[1305]: gitlab 2001:db8:1::1 - - [2026/07/12:13:14:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 701985gitlab # [ 223.167181] gitaly[1404]: time="2026-07-12T13:14:01.915Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KXB7D6KYZGV5BBWTHZ9HCC1M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-12T13:14:31.813" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-12T13:14:01.913" grpc.time_ms=1.867 pid=1404 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1986test script finished in 265.34s1987cleanup1988kill QemuMachine (pid 13)1989gitlab # [ 223.187793] sidekiq-cluster[2163]: {"severity":"INFO","time":"2026-07-12T13:14:01.930Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"666895684de7a398abe1db15","created_at":"2026-07-12T13:14:01.413Z","trace_propagation_headers":{"sentry-trace":"80521b86dd75489ca9e791186bb7e537-724ad00055fc4b57","baggage":"sentry-trace_id=80521b86dd75489ca9e791186bb7e537,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KXB7D6KYZGV5BBWTHZ9HCC1M","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-12T13:14:01.420Z","job_size_bytes":3,"pid":2163,"sidekiq_tid":"m5lf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-666895684de7a398abe1db15: done: 0.503174 sec","job_status":"done","queue_duration_s":0.007462,"scheduling_latency_s":0.00754,"gitaly_calls":4,"gitaly_duration_s":0.245227,"redis_calls":84,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.026969,"redis_read_bytes":174,"redis_write_bytes":21013,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001912,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.003017,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_queues_calls":23,"redis_queues_duration_s":0.007398,"redis_queues_read_bytes":25,"redis_queues_write_bytes":13381,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.007515,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3094,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001464,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":qemu-system-x86_64: terminating on signal 15 from pid 6 (/nix/store/60m4rxhg2fldqaak400c0lry96ijrzqn-python3-3.13.13/bin/python3.13)1990gitlab # 01991(finished: cleanup, in 1.49 seconds)1992additionally exposed symbols:1993 gitlab,1994 vlan1,1995 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh1996[]1997[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-07-12T13:13:47.120Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]1998[]1999[]2000[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '4fecc7ad7664f93e37c7561aaf9789bb02b83fd9', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': [{'level': 'warning', 'message': "unable to download 'https://cache.nixos.org/…': Could not resolve hostname (6) Could not resolve host: cache.nixos.org", 'count': 1}], 'error': None, 'created_at': '2026-07-12T13:13:51.256167Z', 'started_at': '2026-07-12T13:13:51.713756Z', 'finished_at': None}]2001[{'id': 2, 'sha': '4fecc7ad7664f93e37c7561aaf9789bb02b83fd9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-12T13:13:51.692Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2002[{'id': 2, 'sha': '4fecc7ad7664f93e37c7561aaf9789bb02b83fd9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-12T13:13:51.692Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2003[{'id': 2, 'sha': '4fecc7ad7664f93e37c7561aaf9789bb02b83fd9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-12T13:13:51.692Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2004[{'id': 2, 'sha': '4fecc7ad7664f93e37c7561aaf9789bb02b83fd9', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-12T13:13:51.692Z', 'started_at': None, 'finished_at': '2026-07-12T13:13:56.668Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2005[{'id': 2, 'sha': '4fecc7ad7664f93e37c7561aaf9789bb02b83fd9', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-12T13:13:51.692Z', 'started_at': None, 'finished_at': '2026-07-12T13:13:56.668Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '4fecc7ad7664f93e37c7561aaf9789bb02b83fd9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-07-12T13:13:56.816Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2006[{'id': 2, 'sha': '4fecc7ad7664f93e37c7561aaf9789bb02b83fd9', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-12T13:13:51.692Z', 'started_at': None, 'finished_at': '2026-07-12T13:13:56.668Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '4fecc7ad7664f93e37c7561aaf9789bb02b83fd9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-07-12T13:13:56.816Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2007[{'id': 2, 'sha': '4fecc7ad7664f93e37c7561aaf9789bb02b83fd9', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-12T13:13:51.692Z', 'started_at': None, 'finished_at': '2026-07-12T13:13:56.668Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '4fecc7ad7664f93e37c7561aaf9789bb02b83fd9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-07-12T13:13:56.816Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2008[{'id': 2, 'sha': '4fecc7ad7664f93e37c7561aaf9789bb02b83fd9', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-12T13:13:51.692Z', 'started_at': None, 'finished_at': '2026-07-12T13:13:56.668Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '4fecc7ad7664f93e37c7561aaf9789bb02b83fd9', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-07-12T13:13:56.816Z', 'started_at': None, 'finished_at': '2026-07-12T13:14:01.399Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]