vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #247
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.MFfrBHvhqz', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15(finished: start all VMs, in 61.51 seconds)16gitlab # Filesystem UUID: 1545ff8c-e5b4-4186-a442-28cd01b6e21817gitlab: waiting for unit setup-gitlab.service18gitlab # Superblock backups stored on blocks:19gitlab: waiting for the VM to finish booting20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/95114dsfpvi9r91aba82jn5rvrsja5r7-nixos-system-gitlab-test/init regInfo=/nix/store/x1p78jih3vcnvms1av3iwvddv3aanzwx-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 473250309 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor67gitlab # [ 0.000811] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000880] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002748] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002760] Using GB pages for direct mapping73gitlab # [ 0.002806] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002816] ACPI: Early table checksum verification disabled75gitlab # [ 0.002819] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002822] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002827] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002834] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002836] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002837] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002839] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002841] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002842] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002843] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002844] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002844] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002845] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002845] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003080] No NUMA configuration found90gitlab # [ 0.003081] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003084] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.005618] Zone ranges:93gitlab # [ 0.005619] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005621] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005622] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005623] Device empty97gitlab # [ 0.005624] Movable zone start for each node98gitlab # [ 0.005624] Early memory node ranges99gitlab # [ 0.005625] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005626] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005627] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005628] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005654] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005948] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.124477] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.124923] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.124940] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.124977] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.124980] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.124981] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.124983] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.124984] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.124985] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.124987] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.124989] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.124994] TSC deadline timer available117gitlab # [ 0.124999] CPU topo: Max. logical packages: 1118gitlab # [ 0.125000] CPU topo: Max. logical dies: 1119gitlab # [ 0.125000] CPU topo: Max. dies per package: 1120gitlab # [ 0.125004] CPU topo: Max. threads per core: 1121gitlab # [ 0.125004] CPU topo: Num. cores per package: 4122gitlab # [ 0.125004] CPU topo: Num. threads per package: 4123gitlab # [ 0.125005] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.125031] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.125049] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.125051] kvm-guest: setup PV sched yield127gitlab # [ 0.125068] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.125069] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.125070] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.125072] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.125074] Booting paravirtualized kernel on KVM132gitlab # [ 0.125078] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.129537] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.131962] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.132015] kvm-guest: PV spinlocks enabled136gitlab # [ 0.132017] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.132020] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/95114dsfpvi9r91aba82jn5rvrsja5r7-nixos-system-gitlab-test/init regInfo=/nix/store/x1p78jih3vcnvms1av3iwvddv3aanzwx-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.132120] Unknown kernel command line parameters "regInfo=/nix/store/x1p78jih3vcnvms1av3iwvddv3aanzwx-closure-info/registration", will be passed to user space.139gitlab # [ 0.132138] random: crng init done140gitlab # [ 0.132141] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.141920] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.146950] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.147031] software IO TLB: area num 4.144gitlab # [ 0.228519] Fallback order for Node 0: 0145gitlab # [ 0.228529] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.228531] Policy zone: Normal147gitlab # [ 0.231204] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.241746] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.256700] allocated 12582912 bytes of page_ext150gitlab # [ 0.267120] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.267123] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.268064] Dynamic Preempt: lazy153gitlab # [ 0.268263] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.268263] rcu: RCU event tracing is enabled.155gitlab # [ 0.268264] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.268266] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.268266] Rude variant of Tasks RCU enabled.158gitlab # [ 0.268267] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.268267] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.268268] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.268295] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.268297] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.268298] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.272767] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.273055] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.273064] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.273183] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.276773] Console: colour VGA+ 80x25169gitlab # [ 0.276775] printk: legacy console [tty0] enabled170gitlab # [ 0.307399] printk: legacy console [ttyS0] enabled171gitlab # [ 0.404994] ACPI: Core revision 20250807172gitlab # [ 0.405861] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.407400] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.408397] x2apic enabled175gitlab # [ 0.409163] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.410056] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.411275] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.412751] kvm-guest: setup PV IPIs179gitlab # [ 0.414300] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.415313] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns181gitlab # [ 0.417050] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)182gitlab # [ 0.418137] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.419226] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.421047] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.422051] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.423047] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.425048] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.426047] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.427047] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.428047] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.429055] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.430614] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.431047] active return thunk: srso_alias_return_thunk194gitlab # [ 0.432061] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.433047] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.434047] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.435047] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.436047] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.437047] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.438047] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.440047] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.441047] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.442047] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.443047] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.444047] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.445047] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.475711] Freeing SMP alternatives memory: 44K208gitlab # [ 0.476050] pid_max: default: 32768 minimum: 301209gitlab # [ 0.477153] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.478159] landlock: Up and running.211gitlab # [ 0.479047] Yama: becoming mindful.212gitlab # [ 0.480179] LSM support for eBPF active213gitlab # [ 0.481110] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.482211] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.485046] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.485619] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.486052] ... version: 2218gitlab # [ 0.486779] ... bit width: 48219gitlab # [ 0.487049] ... generic counters: 6220gitlab # [ 0.487796] ... generic bitmap: 000000000000003f221gitlab # [ 0.488098] ... fixed-purpose counters: 0222gitlab # [ 0.488861] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.489787] ... value mask: 0000ffffffffffff224gitlab # [ 0.490050] ... max period: 00007fffffffffff225gitlab # [ 0.490980] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.491883] signal: max sigframe size: 3376227gitlab # [ 0.492642] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.493052] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.494130] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.499855] smp: Bringing up secondary CPUs ...231gitlab # [ 0.501083] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.501932] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.506213] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.507771] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)235gitlab # [ 0.508398] Memory: 6011312K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)236gitlab # [ 0.510049] devtmpfs: initialized237gitlab # [ 0.511170] x86/mm: Memory block size: 128MB238gitlab # [ 0.515098] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.516134] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.517160] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.518344] PM: RTC time: 05:52:56, date: 2026-08-20242gitlab # [ 0.522233] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.524513] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.525116] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.527245] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.528068] audit: initializing netlink subsys (disabled)247gitlab # [ 0.529110] audit: type=2000 audit(1787205176.619:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.529375] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.531050] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.532050] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.533049] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.534049] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.535078] cpuidle: using governor menu254gitlab # [ 0.537278] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.538295] PCI: Using configuration type 1 for base access256gitlab # [ 0.539051] PCI: Using configuration type 1 for extended access257gitlab # [ 0.540221] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.542249] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.543051] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.544050] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.545049] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.550478] ACPI: Added _OSI(Module Device)263gitlab # [ 0.552058] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.554056] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.560974] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.567127] ACPI: Interpreter enabled267gitlab # [ 0.569110] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.571056] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.573117] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.576059] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.578409] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.592688] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.594105] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.597847] acpiphp: Slot [3] registered275gitlab # [ 0.599040] acpiphp: Slot [4] registered276gitlab # [ 0.601009] acpiphp: Slot [5] registered277gitlab # [ 0.602025] acpiphp: Slot [6] registered278gitlab # [ 0.603012] acpiphp: Slot [7] registered279gitlab # [ 0.604986] acpiphp: Slot [8] registered280gitlab # [ 0.606022] acpiphp: Slot [9] registered281gitlab # [ 0.607015] acpiphp: Slot [10] registered282gitlab # [ 0.609032] acpiphp: Slot [11] registered283gitlab # [ 0.610033] acpiphp: Slot [12] registered284gitlab # [ 0.611046] acpiphp: Slot [13] registered285gitlab # [ 0.613094] acpiphp: Slot [14] registered286gitlab # [ 0.614093] acpiphp: Slot [15] registered287gitlab # [ 0.615092] acpiphp: Slot [16] registered288gitlab # [ 0.615867] acpiphp: Slot [17] registered289gitlab # [ 0.617070] acpiphp: Slot [18] registered290gitlab # [ 0.617805] acpiphp: Slot [19] registered291gitlab # [ 0.618070] acpiphp: Slot [20] registered292gitlab # [ 0.618809] acpiphp: Slot [21] registered293gitlab # [ 0.620071] acpiphp: Slot [22] registered294gitlab # [ 0.620813] acpiphp: Slot [23] registered295gitlab # [ 0.621079] acpiphp: Slot [24] registered296gitlab # [ 0.621817] acpiphp: Slot [25] registered297gitlab # [ 0.623071] acpiphp: Slot [26] registered298gitlab # [ 0.623814] acpiphp: Slot [27] registered299gitlab # [ 0.624083] acpiphp: Slot [28] registered300gitlab # [ 0.624829] acpiphp: Slot [29] registered301gitlab # [ 0.626071] acpiphp: Slot [30] registered302gitlab # [ 0.626814] acpiphp: Slot [31] registered303gitlab # [ 0.627069] PCI host bridge to bus 0000:00304gitlab # [ 0.627819] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.629102] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.629891] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.631033] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.633034] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.634052] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.635520] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.637729] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.639519] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.642764] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.644078] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.645050] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.646050] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.647050] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.648243] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.651079] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.653134] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.654316] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.656057] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.657281] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.680149] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.682065] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.683065] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.684272] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.685871] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.691081] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.691996] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.692846] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.705159] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.713601] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.724078] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.726071] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.729111] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.735204] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.743090] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.745071] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.747109] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.753295] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.761084] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.763067] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.765116] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.769534] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.780085] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.782074] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.785547] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.791448] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.799083] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.801066] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.803095] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.807872] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.814061] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.814916] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.815832] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.817018] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.820381] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.825129] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.826075] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.829494] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.834096] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.834932] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.835801] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.840171] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.851441] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.854072] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.856112] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.869164] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.872414] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.875420] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.877404] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.880255] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.886449] iommu: Default domain type: Translated375gitlab # [ 0.888054] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.892099] ACPI: bus type USB registered377gitlab # [ 0.893676] usbcore: registered new interface driver usbfs378gitlab # [ 0.895046] usbcore: registered new interface driver hub379gitlab # [ 0.898139] usbcore: registered new device driver usb380gitlab # [ 0.903744] NetLabel: Initializing381gitlab # [ 0.905055] NetLabel: domain hash size = 128382gitlab # [ 0.907055] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.909249] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.912077] PCI: Using ACPI for IRQ routing385gitlab # [ 0.915291] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.916046] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.916046] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.923063] vgaarb: loaded389gitlab # [ 0.925571] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.927053] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.933051] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.940800] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.942596] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.946776] pnp: PnP ACPI init395gitlab # [ 0.949764] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.964685] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.968335] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.970823] NET: Registered PF_INET protocol family399gitlab # [ 0.976229] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 1.004036] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 1.005606] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 1.007023] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 1.011176] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 1.012554] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 1.014288] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 1.015950] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 1.017466] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 1.018925] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 1.019929] NET: Registered PF_XDP protocol family410gitlab # [ 1.020838] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 1.021899] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 1.022968] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 1.024146] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 1.025273] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 1.026667] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 1.027720] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 1.030289] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 1.033705] PCI: CLS 0 bytes, default 64419gitlab # [ 1.034504] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 1.034927] Trying to unpack rootfs image as initramfs...421gitlab # [ 1.035612] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 1.035746] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns423gitlab # [ 1.059457] Initialise system trusted keyrings424gitlab # [ 1.060655] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.072599] Key type asymmetric registered426gitlab # [ 1.073349] Asymmetric key parser 'x509' registered427gitlab # [ 1.074326] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.076062] io scheduler mq-deadline registered429gitlab # [ 1.076871] io scheduler kyber registered430gitlab # [ 1.081748] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.083124] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.085764] Linux agpgart interface v0.103433gitlab # [ 1.086584] ACPI: bus type drm_connector registered434gitlab # [ 1.089554] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.090689] usbserial: USB Serial support registered for generic436gitlab # [ 1.091714] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.091714] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.094079] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.095581] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.096807] NET: Registered PF_INET6 protocol family441gitlab # [ 1.098879] Segment Routing with IPv6442gitlab # [ 1.099618] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.101487] IPI shorthand broadcast: enabled444gitlab # [ 1.105948] sched_clock: Marking stable (969013407, 135982570)->(1131101529, -26105552)445gitlab # [ 1.107823] registered taskstats version 1446gitlab # [ 1.108870] Loading compiled-in X.509 certificates447gitlab # [ 1.119462] Demotion targets for Node 0: null448gitlab # [ 1.120585] Key type .fscrypt registered449gitlab # [ 1.121271] Key type fscrypt-provisioning registered450gitlab # [ 1.122287] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.123235] ima: Allocated hash algorithm: sha1452gitlab # [ 1.124054] ima: No architecture policies found453gitlab # [ 1.125229] PM: Magic number: 6:383:871454gitlab # [ 1.125938] PM: hash matches drivers/base/power/main.c:1117455gitlab # [ 1.127873] RAS: Correctable Errors collector initialized.456gitlab # [ 1.132594] clk: Disabling unused clocks457gitlab # [ 1.133324] PM: genpd: Disabling unused power domains458gitlab # [ 1.335525] Freeing initrd memory: 29392K459gitlab # [ 1.342950] Freeing unused decrypted memory: 2028K460gitlab # [ 1.349550] Freeing unused kernel image (initmem) memory: 3640K461gitlab # [ 1.352480] Write protecting the kernel read-only data: 32768k462gitlab # [ 1.357641] Freeing unused kernel image (text/rodata gap) memory: 1220K463gitlab # [ 1.361783] Freeing unused kernel image (rodata/data gap) memory: 760K464gitlab # [ 1.429340] x86/mm: Checked W+X mappings: passed, no W+X pages found.465gitlab # [ 1.430557] Run /init as init process466gitlab # [ 1.443121] systemd[1]: Inserted module 'autofs4'467gitlab # [ 1.465922] fuse: init (API version 7.45)468gitlab # [ 1.474774] ACPI: \_SB_.LNKC: Enabled at IRQ 10469gitlab # [ 1.482641] ACPI: \_SB_.LNKA: Enabled at IRQ 10470gitlab # [ 1.486481] ACPI: \_SB_.LNKB: Enabled at IRQ 11471gitlab # [ 1.529873] systemd[1]: Successfully made /usr/ read-only.472gitlab # [ 1.866738] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)473gitlab # [ 1.906312] systemd[1]: Detected virtualization kvm.474gitlab # [ 1.908418] systemd[1]: Detected architecture x86-64.475gitlab # [ 1.910456] systemd[1]: Running in initrd.476gitlab # [ 1.912826] systemd[1]: Initializing machine ID from random generator.477gitlab # [ 1.915648] systemd[1]: Hostname set to <gitlab>.478gitlab # [ 2.047664] systemd[1]: bpf-restrict-fs: LSM BPF program attached479gitlab # [ 2.100851] systemd[1]: Queued start job for default target Initrd Default Target.480gitlab # [ 2.113959] systemd[1]: Created slice Slice /system/modprobe.481gitlab # [ 2.115121] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.482gitlab # [ 2.116434] systemd[1]: Expecting device /dev/disk/by-label/nix-store...483gitlab # [ 2.117533] systemd[1]: Expecting device /dev/disk/by-label/nixos...484gitlab # [ 2.118597] systemd[1]: Reached target Path Units.485gitlab # [ 2.119428] systemd[1]: Reached target Slice Units.486gitlab # [ 2.120233] systemd[1]: Reached target Swaps.487gitlab # [ 2.120958] systemd[1]: Reached target Timer Units.488gitlab # [ 2.121916] systemd[1]: Listening on D-Bus System Message Bus Socket.489gitlab # [ 2.123121] systemd[1]: Listening on Journal Socket (/dev/log).490gitlab # [ 2.124192] systemd[1]: Listening on Journal Sockets.491gitlab # [ 2.125104] systemd[1]: Listening on udev Control Socket.492gitlab # [ 2.126096] systemd[1]: Listening on udev Kernel Socket.493gitlab # [ 2.127015] systemd[1]: Reached target Socket Units.494gitlab # [ 2.129219] systemd[1]: Starting Create List of Static Device Nodes...495gitlab # [ 2.131208] systemd[1]: Starting Load Kernel Module 9pnet_virtio...496gitlab # [ 2.133703] systemd[1]: Starting Load Kernel Module configfs...497gitlab # [ 2.142075] systemd[1]: Starting Journal Service...498gitlab # [ 2.146299] systemd[1]: Starting Load Kernel Modules...499gitlab # [ 2.147489] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os500gitlab # [ 2.156078] systemd[1]: Starting Coldplug All udev Devices...501gitlab # [ 2.161086] systemd[1]: Finished Create List of Static Device Nodes.502gitlab # [ 2.163344] systemd[1]: modprobe@configfs.service: Deactivated successfully.503gitlab # [ 2.166274] systemd[1]: Finished Load Kernel Module configfs.504gitlab # [ 2.173609] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config505gitlab # [ 2.183129] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...506gitlab # [ 2.184211] netfs: FS-Cache loaded507gitlab # [ 2.193176] 9pnet: Installing 9P2000 support508gitlab # [ 2.194257] systemd-journald[91]: Collecting audit messages is disabled.509gitlab # [ 2.198271] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.510gitlab # [ 2.199657] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.511gitlab # [ 2.200559] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev512gitlab # [ 2.203109] systemd[1]: Finished Load Kernel Module 9pnet_virtio.513gitlab # [ 2.205488] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.514gitlab # [ 2.207515] systemd[1]: Finished Load Kernel Modules.515gitlab # [ 2.209546] systemd[1]: Starting Apply Kernel Variables...516gitlab # [ 2.211288] systemd[1]: Starting Create Static Device Nodes in /dev...517gitlab # [ 2.222542] systemd[1]: Finished Apply Kernel Variables.518gitlab # [ 2.224202] systemd[1]: Finished Create Static Device Nodes in /dev.519gitlab # [ 2.225563] systemd[1]: Reached target Preparation for Local File Systems.520gitlab # [ 2.226793] systemd[1]: Reached target Local File Systems.521gitlab # [ 2.228874] systemd[1]: Starting Rule-based Manager for Device Events and Files...522gitlab # [ 2.239284] systemd[1]: Started Journal Service.523gitlab # [ 2.103410] systemd-modules-load[92]: Using 4 probe threads524gitlab # [ 2.105434] systemd-modules-load[92]: Inserted module 'virtio_balloon'525gitlab # [ 2.106461] systemd-modules-load[92]: Inserted module 'virtio_gpu'526gitlab # [ 2.107433] systemd-modules-load[92]: Inserted module 'dm_mod'527gitlab # [ 2.108345] systemd[1]: Starting Create System Files and Directories...528gitlab # [ 2.117959] systemd-udevd[102]: Using default interface naming scheme 'v261'.529gitlab # [ 2.121731] systemd[1]: Finished Create System Files and Directories.530gitlab # [ 2.130348] systemd[1]: Started Rule-based Manager for Device Events and Files.531gitlab # [ 2.158175] systemd[1]: Finished Coldplug All udev Devices.532gitlab # [ 2.159504] systemd[1]: Reached target System Initialization.533gitlab # [ 2.160258] systemd[1]: Reached target Basic System.534gitlab # [ 2.364660] uhci_hcd 0000:00:01.2: UHCI Host Controller535gitlab # [ 2.365619] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1536gitlab # [ 2.366656] uhci_hcd 0000:00:01.2: detected 2 ports537gitlab # [ 2.370259] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140538gitlab # [ 2.371866] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18539gitlab # [ 2.373715] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1540gitlab # [ 2.375080] usb usb1: Product: UHCI Host Controller541gitlab # [ 2.375887] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd542gitlab # [ 2.376892] usb usb1: SerialNumber: 0000:00:01.2543gitlab # [ 2.380419] hub 1-0:1.0: USB hub found544gitlab # [ 2.381036] hub 1-0:1.0: 2 ports detected545gitlab # [ 2.382301] SCSI subsystem initialized546gitlab # [ 2.384697] virtio_blk virtio4: 4/0/0 default/read/poll queues547gitlab # [ 2.389050] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)548gitlab # [ 2.416136] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12549gitlab # [ 2.419401] scsi host0: ata_piix550gitlab # [ 2.424070] scsi host1: ata_piix551gitlab # [ 2.424875] virtio_blk virtio5: 4/0/0 default/read/poll queues552gitlab # [ 2.424894] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0553gitlab # [ 2.425054] serio: i8042 KBD port at 0x60,0x64 irq 1554gitlab # [ 2.425063] serio: i8042 AUX port at 0x60,0x64 irq 12555gitlab # [ 2.429759] virtio_blk virtio5: [vdb] 11789104 512-byte logical blocks (6.04 GB/5.62 GiB)556gitlab # [ 2.430280] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0557gitlab # [ 2.319145] (udev-worker)[127]: Network interface NamePolicy= disabled on kernel command line.558gitlab # [ 2.320743] (udev-worker)[137]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.559gitlab # [ 2.322666] (udev-worker)[137]: Network interface NamePolicy= disabled on kernel command line.560gitlab # [ 2.323684] systemd[1]: Starting Virtual Console Setup...561gitlab # [ 2.343833] systemd-vconsole-setup[149]: Configuration of first virtual console was skipped, ignoring remaining ones.562gitlab # [ 2.345345] systemd[1]: Finished Virtual Console Setup.563gitlab # [ 2.593755] ata2: found unknown device (class 0)564gitlab # [ 2.596536] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100565gitlab # [ 2.600891] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5566gitlab # [ 2.611023] usb 1-1: new full-speed USB device number 2 using uhci_hcd567gitlab # [ 2.633823] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0568gitlab # [ 2.520542] systemd[1]: Found device /dev/disk/by-label/nixos.569gitlab # [ 2.522767] systemd[1]: Found device /dev/disk/by-label/nix-store.570gitlab # [ 2.525225] s[ 2.661060] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray571gitlab # ystemd[1]: Reached target Initrd Root Device.572gitlab # [ 2.528589] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...573gitlab # [ 2.699860] cdrom: Uniform CD-ROM driver Revision: 3.20574gitlab # [ 2.572759] systemd-fsck[158]: nixos: clean, 12/65536 files, 13019/262144 blocks575gitlab # [ 2.577807] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.576gitlab # [ 2.779330] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00577gitlab # [ 2.780682] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10578gitlab # [ 2.781696] usb 1-1: Product: QEMU USB Tablet579gitlab # [ 2.782299] usb 1-1: Manufacturer: QEMU580gitlab # [ 2.782850] usb 1-1: SerialNumber: 28754-0000:00:01.2-1581gitlab # [ 2.798838] hid: raw HID events driver (C) Jiri Kosina582gitlab # [ 2.805945] usbcore: registered new interface driver usbhid583gitlab # [ 2.806702] usbhid: USB HID core driver584gitlab # [ 2.811003] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2585gitlab # [ 2.812546] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0586gitlab # [ 3.025582] systemd[1]: Mounting /sysroot...587gitlab # [ 3.314175] EXT4-fs (vda): mounted filesystem 1545ff8c-e5b4-4186-a442-28cd01b6e218 r/w with ordered data mode. Quota mode: none.588gitlab # [ 3.185431] systemd[1]: Mounted /sysroot.589gitlab # [ 3.187176] systemd[1]: Reached target Initrd Root File System.590gitlab # [ 3.190611] systemd[1]: Mounting /sysroot/nix/.ro-store...591gitlab # [ 3.192601] systemd[1]: Mounting /sysroot/nix/.rw-store...592gitlab # [ 3.195851] systemd[1]: Mounting /sysroot/run...593gitlab # [ 3.208751] systemd[1]: Mounting /sysroot/tmp/shared...594gitlab # [ 3.215258] systemd[1]: Mounting /sysroot/tmp/xchg...595gitlab # [ 3.222210] systemd[1]: Starting Mountpoints Configured in the Real Root...596gitlab # [ 3.227160] systemd[1]: Mounted /sysroot/nix/.rw-store.597gitlab # [ 3.234052] systemd[1]: Mounted /sysroot/run.[ 3.370549] erofs (device vdb): mounted with root inode @ nid 128.598gitlab # 599gitlab # [ 3.237214] systemd-sysroot-fstab-check[178]: /sysroot should be mounted in the initrd, will request daemon-reload.600gitlab # [ 3.240899] systemd[1]: Mounted /sysroot/nix/.ro-store.601gitlab # [ 3.242728] systemd[1]: Reload requested from client PID 178 ('systemd-sysroot') (unit initrd-parse-etc.service)...602gitlab # [ 3.245544] s[ 3.381389] 9p: Installing v9fs 9p2000 file system support603gitlab # ystemd[1]: Reloading...604gitlab # [ 3.301104] systemd[1]: Reloading finished in 58 ms.605gitlab # [ 3.324477] systemd-sysroot-fstab-check[178]: Requesting initrd-fs.target/start/replace...606gitlab # [ 3.327349] systemd[1]: Mounted /sysroot/tmp/shared.607gitlab # [ 3.329239] systemd[1]: Mounted /sysroot/tmp/xchg.608gitlab # [ 3.331174] systemd-sysroot-fstab-check[178]: Requesting swap.target/start/replace...609gitlab # [ 3.333752] systemd[1]: Starting rw-sysroot-nix-store.service...610gitlab # [ 3.335866] systemd[1]: initrd-parse-etc.service: Deactivated successfully.611gitlab # [ 3.338243] systemd[1]: Finished Mountpoints Configured in the Real Root.612gitlab # [ 3.340433] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.613gitlab # [ 3.353776] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.614gitlab # [ 3.356384] systemd[1]: Finished rw-sysroot-nix-store.service.615gitlab # [ 4.025701] systemd[1]: Mounting /sysroot/nix/store...616gitlab # [ 4.073785] systemd[1]: Mounted /sysroot/nix/store.617gitlab # [ 4.075766] systemd[1]: Reached target Initrd File Systems.618gitlab # [ 4.077736] systemd[1]: Starting Find NixOS closure...619gitlab # [ 4.079692] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...620gitlab # [ 4.118994] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.621gitlab # [ 4.121861] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.622gitlab # [ 4.135774] systemd[1]: Finished Find NixOS closure.623gitlab # [ 4.137639] systemd[1]: Reached target Initrd Default Target.624gitlab # [ 4.139604] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...625gitlab # [ 4.172628] systemd[1]: Stopped target Initrd Default Target.626gitlab # [ 4.174683] systemd[1]: Stopped target Basic System.627gitlab # [ 4.176469] systemd[1]: Stopped target Initrd Root Device.628gitlab # [ 4.178404] systemd[1]: Stopped target Path Units.629gitlab # [ 4.180358] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.630gitlab # [ 4.182890] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.631gitlab # [ 4.185872] systemd[1]: Stopped target Slice Units.632gitlab # [ 4.187727] systemd[1]: Stopped target Socket Units.633gitlab # [ 4.189535] systemd[1]: Stopped target System Initialization.634gitlab # [ 4.192437] systemd[1]: Stopped target Swaps.635gitlab # [ 4.194335] systemd[1]: Stopped target Timer Units.636gitlab # [ 4.198134] systemd[1]: dbus.socket: Deactivated successfully.637gitlab # [ 4.200242] systemd[1]: Closed D-Bus System Message Bus Socket.638gitlab # [ 4.202346] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.639gitlab # [ 4.204900] systemd[1]: Stopped Find NixOS closure.640gitlab # [ 4.206729] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio641gitlab # [ 4.210303] systemd[1]: Starting rw-sysroot-nix-store.service...642gitlab # [ 4.212441] systemd[1]: systemd-sysctl.service: Deactivated successfully.643gitlab # [ 4.214383] systemd[1]: Stopped Apply Kernel Variables.644gitlab # [ 4.215898] systemd[1]: systemd-modules-load.service: Deactivated successfully.645gitlab # [ 4.217808] systemd[1]: Stopped Load Kernel Modules.646gitlab # [ 4.219208] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.647gitlab # [ 4.221264] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.648gitlab # [ 4.223270] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.649gitlab # [ 4.225174] systemd[1]: Stopped Create System Files and Directories.650gitlab # [ 4.226887] systemd[1]: Stopped target Local File Systems.651gitlab # [ 4.228459] systemd[1]: Stopped target Preparation for Local File Systems.652gitlab # [ 4.230473] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.653gitlab # [ 4.231850] systemd[1]: Stopped Coldplug All udev Devices.654gitlab # [ 4.232601] systemd[1]: Stopping Rule-based Manager for Device Events and Files...655gitlab # [ 4.233674] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.656gitlab # [ 4.234663] systemd[1]: Stopped Virtual Console Setup.657gitlab # [ 4.235352] systemd[1]: initrd-cleanup.service: Deactivated successfully.658gitlab # [ 4.236231] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.659gitlab # [ 4.237151] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.660gitlab # [ 4.238105] systemd[1]: Finished rw-sysroot-nix-store.service.661gitlab # [ 4.238876] systemd[1]: systemd-udevd.service: Deactivated successfully.662gitlab # [ 4.239756] systemd[1]: Stopped Rule-based Manager for Device Events and Files.663gitlab # [ 4.240708] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.664gitlab # [ 4.241675] systemd[1]: Closed udev Control Socket.665gitlab # [ 4.242344] systemd[1]: Starting Cleanup udev Database...666gitlab # [ 4.243092] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.667gitlab # [ 4.244097] systemd[1]: Stopped Create Static Device Nodes in /dev.668gitlab # [ 4.244925] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.669gitlab # [ 4.245952] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.670gitlab # [ 4.246897] systemd[1]: kmod-static-nodes.service: Deactivated successfully.671gitlab # [ 4.247825] systemd[1]: Stopped Create List of Static Device Nodes.672gitlab # [ 4.248762] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.673gitlab # [ 4.249856] systemd[1]: Finished Cleanup udev Database.674gitlab # [ 4.250608] systemd[1]: Reached target Switch Root.675gitlab # [ 4.251580] systemd[1]: Starting NixOS Activation...676gitlab # [ 4.378881] initrd-nixos-activation-start[225]: booting system configuration /nix/store/95114dsfpvi9r91aba82jn5rvrsja5r7-nixos-system-gitlab-test677gitlab # [ 4.421445] initrd-nixos-activation-start[225]: running activation script...678gitlab # [ 4.689792] initrd-nixos-activation-start[248]: setting up /etc...679gitlab # [ 4.809851] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.680gitlab # [ 4.812470] systemd[1]: Finished NixOS Activation.681gitlab # [ 4.814221] systemd[1]: Starting Switch Root...682gitlab # [ 4.844448] systemd[1]: Switching root.683gitlab # [ 5.039447] systemd-journald[91]: Received SIGTERM from PID 1 (systemd).684gitlab # [ 5.166137] NET: Registered PF_VSOCK protocol family685gitlab # [ 5.535276] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)686gitlab # [ 5.542700] systemd[1]: Detected virtualization kvm.687gitlab # [ 5.544128] systemd[1]: Detected architecture x86-64.688gitlab # [ 5.545608] systemd[1]: Detected first boot.689gitlab # [ 5.547604] systemd[1]: Initializing machine ID from random generator.690gitlab # [ 5.682633] systemd[1]: bpf-restrict-fs: LSM BPF program attached691gitlab # [ 5.771652] systemd[1]: Applying preset policy.692gitlab # [ 5.931589] systemd[1]: Populated /etc with preset unit settings.693gitlab # [ 6.060210] systemd[1]: initrd-switch-root.service: Deactivated successfully.694gitlab # [ 6.061547] systemd[1]: Stopped initrd-switch-root.service.695gitlab # [ 6.063745] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.696gitlab # [ 6.065754] systemd[1]: Created slice Slice /system/getty.697gitlab # [ 6.067335] systemd[1]: Created slice GitLab DevOps Platform Slice.698gitlab # [ 6.068715] systemd[1]: Created slice User and Session Slice.699gitlab # [ 6.069630] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.700gitlab # [ 6.070896] systemd[1]: Started Forward Password Requests to Wall Directory Watch.701gitlab # [ 6.071955] systemd[1]: Expecting device /dev/hvc0...702gitlab # [ 6.072666] systemd[1]: Expecting device /dev/ttyS0...703gitlab # [ 6.073399] systemd[1]: Reached target Local Encrypted Volumes.704gitlab # [ 6.074194] systemd[1]: Stopped target initrd-fs.target.705gitlab # [ 6.074903] systemd[1]: Stopped target initrd-root-fs.target.706gitlab # [ 6.075709] systemd[1]: Stopped target initrd-switch-root.target.707gitlab # [ 6.076546] systemd[1]: Reached target Virtual Machines and Containers.708gitlab # [ 6.077432] systemd[1]: Reached target Path Units.709gitlab # [ 6.078128] systemd[1]: Reached target Remote File Systems.710gitlab # [ 6.078881] systemd[1]: Reached target Slice Units.711gitlab # [ 6.079599] systemd[1]: Reached target Swaps.712gitlab # [ 6.081009] systemd[1]: Listening on Query the User Interactively for a Password.713gitlab # [ 6.082916] systemd[1]: Listening on Process Core Dump Socket.714gitlab # [ 6.084271] systemd[1]: Listening on Credential Encryption/Decryption.715gitlab # [ 6.085863] systemd[1]: Listening on Factory Reset Management.716gitlab # [ 6.086826] systemd[1]: Listening on Hostname Service Socket.717gitlab # [ 6.089195] systemd[1]: Starting Journal Log Access Socket...718gitlab # [ 6.090575] systemd[1]: Listening on Journal Audit Socket.719gitlab # [ 6.092601] systemd[1]: Listening on Console Output Muting Service Socket.720gitlab # [ 6.093716] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.721gitlab # [ 6.094856] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os722gitlab # [ 6.096140] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki723gitlab # [ 6.098910] systemd[1]: Listening on Disk Repartitioning Service Socket.724gitlab # [ 6.099928] systemd[1]: Listening on udev Control Socket.725gitlab # [ 6.100797] systemd[1]: Listening on udev Varlink Socket.726gitlab # [ 6.103948] systemd[1]: Mounting Huge Pages File System...727gitlab # [ 6.105867] systemd[1]: Mounting POSIX Message Queue File System...728gitlab # [ 6.107819] systemd[1]: Mounting Kernel Debug File System...729gitlab # [ 6.111059] systemd[1]: Mounting Kernel Trace File System...730gitlab # [ 6.116489] systemd[1]: Starting Create List of Static Device Nodes...731gitlab # [ 6.119159] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio732gitlab # [ 6.159182] systemd[1]: Starting Load Kernel Module configfs...733gitlab # [ 6.161312] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm734gitlab # [ 6.164680] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore735gitlab # [ 6.168142] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse736gitlab # [ 6.172671] systemd[1]: Mounting FUSE Control File System...737gitlab # [ 6.174357] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67738gitlab # [ 6.181835] systemd[1]: Starting Journal Service...739gitlab # [ 6.185478] systemd[1]: Starting Load Kernel Modules...740gitlab # [ 6.190055] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...741gitlab # [ 6.196874] systemd[1]: Starting Remount Root and Kernel File Systems...742gitlab # [ 6.199241] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os743gitlab # [ 6.200789] systemd-journald[318]: Collecting audit messages is enabled.744gitlab # [ 6.204709] systemd[1]: Starting Coldplug All udev Devices...745gitlab # [ 6.213201] systemd[1]: Listening on Journal Log Access Socket.746gitlab # [ 6.215618] systemd[1]: Mounted Huge Pages File System.747gitlab # [ 6.217588] systemd[1]: Mounted POSIX Message Queue File System.748gitlab # [ 6.219313] EXT4-fs (vda): re-mounted 1545ff8c-e5b4-4186-a442-28cd01b6e218.749gitlab # [ 6.086828] systemd[1]: Queued start job for default target Multi-User System.750gitlab # [ 6.222875] systemd[1]: Mounted Kernel Debug File System.751gitlab # [ 6.088182] systemd[1]: Unnecessary job was removed for /dev/vdb.752gitlab # [ 6.090286] systemd[1]: systemd-journald.service: Deactivated successfully.753gitlab # [ 6.227378] systemd[1]: Started Journal Service.754gitlab # [ 6.091913] systemd-modules-load[319]: Using 3 probe threads755gitlab # [ 6.093742] systemd-modules-load[319]: Inserted module 'tls'756gitlab # [ 6.094786] systemd[1]: Mounted Kernel Trace File System.757gitlab # [ 6.095772] systemd[1]: Finished Create List of Static Device Nodes.758gitlab # [ 6.096837] systemd[1]: modprobe@configfs.service: Deactivated successfully.759gitlab # [ 6.233637] loop: module loaded760gitlab # [ 6.098061] systemd[1]: Finished Load Kernel Module configfs.761gitlab # [ 6.099529] systemd[1]: Mounted FUSE Control File System.762gitlab # [ 6.100511] systemd[1]: Finished Remount Root and Kernel File Systems.763gitlab # [ 6.101512] systemd-modules-load[319]: Inserted module 'loop'764gitlab # [ 6.102312] systemd[1]: Finished Load Kernel Modules.765gitlab # [ 6.103281] systemd[1]: Listening on Disk Image Download Service Socket.766gitlab # [ 6.106266] systemd[1]: Mounting Kernel Configuration File System...767gitlab # [ 6.107339] systemd-oomd[321]: No swap; memory pressure usage will be degraded768gitlab # [ 6.109558] systemd[1]: Starting Firewall...769gitlab # [ 6.118101] systemd[1]: Starting Flush Journal to Persistent Storage...770gitlab # [ 6.119960] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore771gitlab # [ 6.121972] systemd[1]: Starting Load/Save OS Random Seed...772gitlab # [ 6.123681] systemd[1]: Starting Apply Kernel Variables...773gitlab # [ 6.125132] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...774gitlab # [ 6.126270] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os775gitlab # [ 6.129080] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.776gitlab # [ 6.266331] systemd-journald[318]: Received client request to flush runtime journal.777gitlab # [ 6.185587] systemd[1]: Mounted Kernel Configuration File System.778gitlab # [ 6.186668] systemd[1]: Finished Load/Save OS Random Seed.779gitlab # [ 6.187839] systemd[1]: Reached target First Boot Complete.780gitlab # [ 6.189064] systemd[1]: Finished Apply Kernel Variables.781gitlab # [ 6.189982] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.782gitlab # [ 6.191200] systemd[1]: Starting Create Static Device Nodes in /dev...783gitlab # [ 6.192146] systemd[1]: Finished Create Static Device Nodes in /dev.784gitlab # [ 6.193058] systemd[1]: Reached target Preparation for Local File Systems.785gitlab # [ 6.193951] systemd[1]: Starting Rule-based Manager for Device Events and Files...786gitlab # [ 6.195024] systemd[1]: Finished Flush Journal to Persistent Storage.787gitlab # [ 6.201308] systemd-udevd[355]: Using default interface naming scheme 'v261'.788gitlab # [ 6.234887] systemd[1]: Finished Coldplug All udev Devices.789gitlab # [ 6.240134] systemd[1]: Started Rule-based Manager for Device Events and Files.790gitlab # [ 6.310473] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse791gitlab # [ 6.347109] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.792gitlab # [ 6.349245] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.793gitlab # [ 6.355815] systemd[1]: Finished Firewall.794gitlab # [ 6.358807] (udev-worker)[436]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.795gitlab # [ 6.360849] (udev-worker)[436]: Network interface NamePolicy= disabled on kernel command line.796gitlab # [ 6.365227] (udev-worker)[433]: Network interface NamePolicy= disabled on kernel command line.797gitlab # [ 6.530173] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3798gitlab # [ 6.535471] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console799gitlab # [ 6.536039] ACPI: button: Power Button [PWRF]800gitlab # [ 6.405865] systemd[1]: Condition check resulted in Virtio network device being skipped.801gitlab # [ 6.412256] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore802gitlab # [ 6.413968] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67803gitlab # [ 6.416137] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore804gitlab # [ 6.417874] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os805gitlab # [ 6.419120] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os806gitlab # [ 6.557742] Console: switching to colour dummy device 80x25807gitlab # [ 6.558588] [drm] Found bochs VGA, ID 0xb0c5.808gitlab # [ 6.559093] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.809gitlab # [ 6.560306] rtc_cmos 00:05: RTC can wake from S4810gitlab # [ 6.560316] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0811gitlab # [ 6.564835] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD812gitlab # [ 6.566466] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic813gitlab # [ 6.567192] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0814gitlab # [ 6.569071] rtc_cmos 00:05: registered as rtc0815gitlab # [ 6.569585] rtc_cmos 00:05: setting system clock to 2026-08-20T05:53:02 UTC (1787205182)816gitlab # [ 6.571276] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs817gitlab # [ 6.577269] Floppy drive(s): fd0 is 2.88M AMI BIOS818gitlab # [ 6.577899] systemd-journald[318]: Time jumped backwards, rotating.819gitlab # [ 6.585898] Console: switching to colour frame buffer device 160x50820gitlab # [ 6.589155] FDC 0 is a S82078B821gitlab # [ 6.605314] parport_pc 00:03: reported by Plug and Play ACPI822gitlab # [ 6.605416] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]823gitlab # [ 6.610554] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device824gitlab # [ 6.612959] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4825gitlab # [ 6.637555] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6826gitlab # [ 6.556095] systemd[1]: Starting Virtual Console Setup...827gitlab # [ 6.710227] mousedev: PS/2 mouse device common for all mice828gitlab # [ 6.579075] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.829gitlab # [ 6.587055] systemd[1]: Stopped Virtual Console Setup.830gitlab # [ 6.596450] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 6.736602] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5832gitlab # [ 6.602152] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.833gitlab # [ 6.603321] systemd[1]: Stopped Virtual Console Setup.834gitlab # [ 6.604172] systemd[1]: Starting Virtual Console Setup...835gitlab # [ 6.748511] ppdev: user-space parallel port driver836gitlab # [ 6.785014] kvm_amd: TSC scaling supported837gitlab # [ 6.785587] kvm_amd: Nested Virtualization enabled838gitlab # [ 6.786232] kvm_amd: Nested Paging enabled839gitlab # [ 6.786700] kvm_amd: LBR virtualization supported840gitlab # [ 6.787290] kvm_amd: Virtual VMLOAD VMSAVE supported841gitlab # [ 6.787878] kvm_amd: Virtual GIF supported842gitlab # [ 6.788397] kvm_amd: Virtual NMI enabled843gitlab # [ 6.681821] systemd-vconsole-setup[491]: Configuration of first virtual console was skipped, ignoring remaining ones.844gitlab # [ 6.683569] systemd[1]: Finished Virtual Console Setup.845gitlab # [ 6.824268] EDAC MC: Ver: 3.0.0846gitlab # [ 6.929439] systemd[1]: Mounting /run/wrappers...847gitlab # [ 6.957692] systemd[1]: Mounted /run/wrappers.848gitlab # [ 6.959495] systemd[1]: Reached target Local File Systems.849gitlab # [ 6.961418] systemd[1]: Listening on Boot Loader Control Service Socket.850gitlab # [ 6.963790] systemd[1]: Starting register-nix-paths.service...851gitlab # [ 6.965925] systemd[1]: Starting Create SUID/SGID Wrappers...852gitlab # [ 6.968157] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.853gitlab # [ 6.971153] systemd[1]: Starting Save Transient machine-id to Disk...854gitlab # [ 6.977238] systemd[1]: Starting Create System Files and Directories...855gitlab # [ 7.010214] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.856gitlab # [ 7.018263] systemd[1]: Finished Save Transient machine-id to Disk.857gitlab # [ 7.021050] systemd[1]: Finished Create System Files and Directories.858gitlab # [ 7.024595] systemd[1]: Starting Rebuild Journal Catalog...859gitlab # [ 7.029143] systemd[1]: Starting Record System Boot/Shutdown in UTMP...860gitlab # [ 7.048554] systemd[1]: Finished Record System Boot/Shutdown in UTMP.861gitlab # [ 7.062541] systemd[1]: Finished Rebuild Journal Catalog.862gitlab # [ 7.064533] systemd[1]: Starting Update is Completed...863gitlab # [ 7.079605] systemd[1]: Finished Update is Completed.864gitlab # [ 7.136331] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.865gitlab # [ 7.138291] systemd[1]: Finished Create SUID/SGID Wrappers.866gitlab # [ 7.408227] systemd[1]: Finished register-nix-paths.service.867gitlab # [ 7.410491] systemd[1]: Reached target System Initialization.868gitlab # [ 7.412684] systemd[1]: Started Discard unused filesystem blocks once a week.869gitlab # [ 7.415229] systemd[1]: Started logrotate.timer.870gitlab # [ 7.417103] systemd[1]: Started Daily Cleanup of Temporary Directories.871gitlab # [ 7.419505] systemd[1]: Reached target Timer Units.872gitlab # [ 7.421375] systemd[1]: Listening on D-Bus System Message Bus Socket.873gitlab # [ 7.423665] systemd[1]: Listening on Nix Daemon Socket.874gitlab # [ 7.425570] systemd[1]: Starting nixbot CI service socket...875gitlab # [ 7.427661] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.876gitlab # [ 7.430523] systemd[1]: Listening on nixbot CI service socket.877gitlab # [ 7.432663] systemd[1]: Reached target Socket Units.878gitlab # [ 7.434710] systemd[1]: Starting D-Bus System Message Bus...879gitlab # [ 7.494629] dbus-broker-launch[574]: Looking up NSS user entry for 'systemd-timesync'...880gitlab # [ 7.498221] dbus-broker-launch[574]: NSS returned no entry for 'systemd-timesync'881gitlab # [ 7.500979] dbus-broker-launch[574]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"882gitlab # [ 7.506246] systemd[1]: Started D-Bus System Message Bus.883gitlab # [ 7.528476] dbus-broker-launch[574]: Ready884gitlab # [ 7.532486] systemd[1]: Reached target Basic System.885gitlab # [ 7.535684] systemd[1]: Started backdoor.service.886gitlab # [ 7.540521] systemd[1]: Starting gitlab-config.service...887gitlab # [ 7.549648] systemd[1]: Starting Import lastlog data into lastlog2 database...888gitlab # [ 7.554654] systemd[1]: Starting Logrotate configuration check...889gitlab # [ 7.559580] systemd[1]: Starting Name Service Cache Daemon (nsncd)...890gitlab # [ 7.564970] systemd[1]: Starting Post-Boot Actions...891gitlab # connecting to host...892gitlab # [ 7.577822] systemd[1]: Started Reset console on configuration changes.893gitlab # [ 7.585802] logrotate[579]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.894gitlab # [ 7.585979] logrotate[579]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf895gitlab: Guest shell says: b'Spawning backdoor root shell...\n'896gitlab # [ 7.592722] logrotate[579]: note: 'monthly' overrides previously specified 'weekly'897gitlab # [ 7.593472] systemd[1]: Starting resolvconf update...898gitlab: connected to guest root shell899gitlab # [ 7.598153] logrotate[579]: Reading state from file: /var/lib/logrotate.status900gitlab: (connecting took 8.22 seconds)901gitlab # [ 7.599172] logrotate[579]: state file /var/lib/logrotate.status does not exist902gitlab: (finished: waiting for the VM to finish booting, in 8.22 seconds)903gitlab # [ 7.599473] logrotate[579]: Allocating hash table for state file, size 64 entries904gitlab # [ 7.599946] logrotate[579]: Handling 4 logs905gitlab # [ 7.600458] logrotate[579]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed906gitlab # [ 7.600943] logrotate[579]: considering log /var/log/btmp907gitlab # [ 7.601533] logrotate[579]: Creating new state908gitlab # [ 7.601983] logrotate[579]: Now: 2026-08-20 05:53909gitlab # [ 7.602544] logrotate[579]: Last rotated at 2026-08-20 05:00910gitlab # [ 7.603032] logrotate[579]: log does not need rotating (log has already been rotated)911gitlab # [ 7.603448] logrotate[579]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed912gitlab # [ 7.603884] logrotate[579]: considering log /var/log/wtmp913gitlab # [ 7.604298] logrotate[579]: Creating new state914gitlab # [ 7.604807] logrotate[579]: Now: 2026-08-20 05:53915gitlab # [ 7.605390] logrotate[579]: Last rotated at 2026-08-20 05:00916gitlab # [ 7.606240] logrotate[579]: log does not need rotating (log has already been rotated)917gitlab # [ 7.606703] logrotate[579]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed918gitlab # [ 7.607540] logrotate[579]: switching euid from 0 to 165 and egid from 0 to 165 (pid 579)919gitlab # [ 7.608442] logrotate[579]: considering log /var/gitlab/state/log/*.log920gitlab # [ 7.608862] logrotate[579]: log /var/gitlab/state/log/*.log does not exist -- skipping921gitlab # [ 7.609476] logrotate[579]: Creating new state922gitlab # [ 7.609892] logrotate[579]: switching euid from 165 to 0 and egid from 165 to 0 (pid 579)923gitlab # [ 7.610606] logrotate[579]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed924gitlab # [ 7.611167] logrotate[579]: switching euid from 0 to 60 and egid from 0 to 60 (pid 579)925gitlab # [ 7.611614] logrotate[579]: considering log /var/log/nginx/*.log926gitlab # [ 7.612281] logrotate[579]: log /var/log/nginx/*.log does not exist -- skipping927gitlab # [ 7.613339] logrotate[579]: Creating new state928gitlab # [ 7.613839] logrotate[579]: not running postrotate script, since no logs were rotated929gitlab # [ 7.614609] logrotate[579]: switching euid from 60 to 0 and egid from 60 to 0 (pid 579)930gitlab # [ 7.617402] systemd[1]: Started Name Service Cache Daemon (nsncd).931gitlab # [ 7.618323] nsncd[580]: Aug 20 05:53:03.679 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"932gitlab # [ 7.619049] systemd[1]: Finished Logrotate configuration check.933gitlab # [ 7.621196] systemd[1]: Finished Post-Boot Actions.934gitlab # [ 7.626934] systemd[1]: Finished Import lastlog data into lastlog2 database.935gitlab # [ 7.636444] systemd[1]: Reached target Host and Network Name Lookups.936gitlab # [ 7.636894] systemd[1]: Reached target User and Group Name Lookups.937gitlab # [ 7.642078] systemd[1]: Starting User Login Management...938gitlab # [ 7.659035] systemd[1]: Stopped target Host and Network Name Lookups.939gitlab # [ 7.660155] systemd[1]: Stopping Host and Network Name Lookups...940gitlab # [ 7.660618] systemd[1]: Stopped target User and Group Name Lookups.941gitlab # [ 7.661074] systemd[1]: Stopping User and Group Name Lookups...942gitlab # [ 7.661514] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...943gitlab # [ 7.663571] systemd[1]: nscd.service: Deactivated successfully.944gitlab # [ 7.664328] systemd[1]: Stopped Name Service Cache Daemon (nsncd).945gitlab # [ 7.664758] systemd[1]: nscd.service: Consumed 22ms CPU time over 104ms wall clock time, 7.2M memory peak, 5.5M read from disk.946gitlab # [ 7.668944] systemd[1]: Starting Name Service Cache Daemon (nsncd)...947gitlab # [ 7.681504] systemd-logind[637]: New seat seat0.948gitlab # [ 7.685950] systemd-logind[637]: Watching system buttons on /dev/input/event2 (Power Button)949gitlab # [ 7.686155] systemd-logind[637]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)950gitlab # [ 7.686728] systemd-logind[637]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)951gitlab # [ 7.687168] systemd[1]: Started User Login Management.952gitlab # [ 7.692229] nsncd[670]: Aug 20 05:53:03.757 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"953gitlab # [ 7.694175] systemd[1]: Starting linger-users.service...954gitlab # [ 7.694477] systemd[1]: Started Name Service Cache Daemon (nsncd).955gitlab # [ 7.694899] systemd[1]: Finished resolvconf update.956gitlab # [ 7.696964] systemd[1]: Reached target Preparation for Network.957gitlab # [ 7.697744] systemd[1]: Reached target Host and Network Name Lookups.958gitlab # [ 7.698323] systemd[1]: Reached target User and Group Name Lookups.959gitlab # [ 7.701992] systemd[1]: Starting DHCP Client...960gitlab # [ 7.703522] systemd[1]: Starting Address configuration of eth1...961gitlab # [ 7.707377] systemd[1]: Starting Extra networking commands....962gitlab # [ 7.708901] systemd[1]: linger-users.service: Deactivated successfully.963gitlab # [ 7.712165] systemd[1]: Finished linger-users.service.964gitlab # [ 7.736481] network-addresses-eth1-start[696]: adding address 192.168.1.1/24... done965gitlab # [ 7.739043] network-addresses-eth1-start[696]: adding address 2001:db8:1::1/64... done966gitlab # [ 7.743661] systemd[1]: Finished Address configuration of eth1.967gitlab # [ 7.769227] systemd[1]: Finished Extra networking commands..968gitlab # [ 7.769723] systemd[1]: Reached target Network.969gitlab # [ 7.771072] systemd[1]: Starting gitlab-workhorse.service...970gitlab # [ 7.774589] dhcpcd[707]: dhcpcd-10.3.2 starting971gitlab # [ 7.774781] systemd[1]: Starting Nginx Web Server...972gitlab # [ 7.776355] systemd[1]: Starting PostgreSQL Server...973gitlab # [ 7.777640] dhcpcd[764]: dev: loaded udev974gitlab # [ 7.779606] systemd[1]: Starting Redis Server - redis-gitlab...975gitlab # [ 7.918764] 8021q: 802.1Q VLAN Support v1.8976gitlab # [ 7.783340] systemd[1]: Start[ 7.919613] 8021q: adding VLAN 0 to HW filter on device eth1977gitlab # ing Permit User Sessions...978gitlab # [ 7.797959] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.979gitlab # [ 7.806503] systemd[1]: Finished Permit User Sessions.980gitlab # [ 7.810352] systemd[1]: Started Getty on tty1.981gitlab # [ 7.811119] systemd[1]: Reached target Login Prompts.982gitlab # [ 8.001614] cfg80211: Loading compiled-in X.509 certificates for regulatory database983gitlab # [ 8.008491] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'984gitlab # [ 8.009327] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'985gitlab # [ 8.010557] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2986gitlab # [ 8.011765] cfg80211: failed to load regulatory.db987gitlab # [ 7.902937] nginx-pre-start[787]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok988gitlab # [ 7.905203] nginx-pre-start[787]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful989gitlab # [ 8.042241] 8021q: adding VLAN 0 to HW filter on device eth0990gitlab # [ 7.909813] dhcpcd[764]: eth0: waiting for carrier991gitlab # [ 7.910493] dhcpcd[764]: eth0: carrier acquired992gitlab # [ 7.913125] systemd[1]: Started Nginx Web Server.993gitlab # [ 7.916604] redis-server[786]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.994gitlab # [ 7.916971] redis-server[786]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo995gitlab # [ 7.917742] redis-server[786]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=786, just started996gitlab # [ 7.918356] redis-server[786]: Configuration loaded997gitlab # [ 7.918959] redis[786]: monotonic clock: POSIX clock_gettime998gitlab # [ 7.920466] redis[786]: Running mode=standalone, port=0.999gitlab # [ 7.921644] redis[786]: Server initialized1000gitlab # [ 7.922265] systemd[1]: Started Redis Server - redis-gitlab.1001gitlab # [ 7.922772] redis[786]: Ready to accept connections unix1002gitlab # [ 7.923500] redis[786]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1003gitlab # [ 7.924532] dhcpcd[764]: DUID 00:01:00:01:32:19:52:bf:52:54:00:12:34:561004gitlab # [ 7.925471] dhcpcd[764]: eth0: IAID 00:12:34:561005gitlab # [ 7.925928] dhcpcd[764]: eth0: adding address fe80::5054:ff:fe12:34561006gitlab # [ 7.937081] postgresql-pre-start[789]: The files belonging to this database system will be owned by user "postgres".1007gitlab # [ 7.937419] postgresql-pre-start[789]: This user must also own the server process.1008gitlab # [ 7.942287] postgresql-pre-start[789]: The database cluster will be initialized with locale "en_US.UTF-8".1009gitlab # [ 7.943626] postgresql-pre-start[789]: The default database encoding has accordingly been set to "UTF8".1010gitlab # [ 7.944799] postgresql-pre-start[789]: The default text search configuration will be set to "english".1011gitlab # [ 7.946057] postgresql-pre-start[789]: Data page checksums are enabled.1012gitlab # [ 7.946947] postgresql-pre-start[789]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1013gitlab # [ 7.948153] postgresql-pre-start[789]: creating subdirectories ... ok1014gitlab # [ 7.948996] postgresql-pre-start[789]: selecting dynamic shared memory implementation ... posix1015gitlab # [ 7.973732] postgresql-pre-start[789]: selecting default "max_connections" ... 1001016gitlab # [ 8.019323] postgresql-pre-start[789]: selecting default "shared_buffers" ... 128MB1017gitlab # [ 8.295455] systemd[1]: Started gitlab-workhorse.service.1018gitlab # [ 8.374785] postgresql-pre-start[789]: selecting default time zone ... UTC1019gitlab # [ 8.377348] postgresql-pre-start[789]: creating configuration files ... ok1020gitlab # [ 8.537605] gitlab-workhorse[822]: time="2026-08-20T05:53:04Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41021gitlab # [ 8.537810] gitlab-workhorse[822]: time="2026-08-20T05:53:04Z" level=info msg="Using redis/go-redis"1022gitlab # [ 8.538372] gitlab-workhorse[822]: time="2026-08-20T05:53:04Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1023gitlab # [ 8.552109] postgresql-pre-start[789]: running bootstrap script ... ok1024gitlab # [ 8.995945] postgresql-pre-start[789]: performing post-bootstrap initialization ... ok1025gitlab # [ 9.293870] postgresql-pre-start[789]: syncing data to disk ... ok1026gitlab # [ 9.294095] postgresql-pre-start[789]: initdb: warning: enabling "trust" authentication for local connections1027gitlab # [ 9.294898] postgresql-pre-start[789]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1028gitlab # [ 9.295467] postgresql-pre-start[789]: Success. You can now start the database server using:1029gitlab # [ 9.296302] postgresql-pre-start[789]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1030gitlab # [ 9.423439] postgres[847]: [847] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1031gitlab # [ 9.427344] postgres[847]: [847] LOG: listening on IPv6 address "::1", port 54321032gitlab # [ 9.427558] postgres[847]: [847] LOG: listening on IPv4 address "127.0.0.1", port 54321033gitlab # [ 9.436828] postgres[847]: [847] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1034gitlab # [ 9.453100] postgres[856]: [856] LOG: database system was shut down at 2026-08-20 05:53:05 GMT1035gitlab # [ 9.460527] postgres[847]: [847] LOG: database system is ready to accept connections1036gitlab # [ 9.463651] systemd[1]: Started PostgreSQL Server.1037gitlab # [ 9.466864] systemd[1]: Starting PostgreSQL Setup Scripts...1038gitlab # [ 9.603318] dhcpcd[764]: eth0: soliciting a DHCP lease1039gitlab # [ 9.744883] NET: Registered PF_PACKET protocol family1040gitlab # [ 9.616853] dhcpcd[764]: eth0: offered 10.0.2.15 from 10.0.2.21041gitlab # [ 9.622190] dhcpcd[764]: eth0: probing address 10.0.2.15/241042gitlab # [ 9.644292] postgresql-setup-start[871]: CREATE DATABASE1043gitlab # [ 9.658359] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[864]: mkdir -p /var/gitlab/state/home/.ssh: OK1044gitlab # [ 9.659462] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[864]: chmod 700 /var/gitlab/state/home/.ssh: OK1045gitlab # [ 9.678066] postgresql-setup-start[884]: CREATE ROLE1046gitlab # [ 9.687787] postgresql-setup-start[889]: ALTER DATABASE1047gitlab # [ 9.696561] systemd[1]: Finished gitlab-config.service.1048gitlab # [ 9.698910] systemd[1]: Started gitaly.service.1049gitlab # [ 9.710362] postgresql-setup-start[899]: CREATE ROLE1050gitlab # [ 9.714629] systemd[1]: Finished PostgreSQL Setup Scripts.1051gitlab # [ 9.717171] systemd[1]: Reached target PostgreSQL.1052gitlab # [ 9.718653] systemd[1]: Starting gitlab-db-config.service...1053gitlab # [ 9.719827] systemd[1]: Starting gitlab-postgresql.service...1054gitlab # [ 9.810513] gitlab-postgresql-start[919]: CREATE DATABASE1055gitlab # [ 9.846415] gitlab-postgresql-start[924]: CREATE EXTENSION1056gitlab # [ 9.929483] gitlab-postgresql-start[926]: CREATE EXTENSION1057gitlab # [ 9.933406] systemd[1]: Finished gitlab-postgresql.service.1058gitlab # [ 10.221480] dhcpcd[764]: eth0: soliciting an IPv6 router1059gitlab # [ 10.222418] dhcpcd[764]: eth0: Router Advertisement from fe80::21060gitlab # [ 10.222806] dhcpcd[764]: eth0: adding address fec0::5054:ff:fe12:3456/641061gitlab # [ 10.223512] dhcpcd[764]: eth0: adding route to fec0::/641062gitlab # [ 10.224018] dhcpcd[764]: eth0: adding default route via fe80::21063gitlab # [ 10.246485] gitaly[898]: time="2026-08-20T05:53:06.312Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=8981064gitlab # [ 10.254256] gitaly[898]: time="2026-08-20T05:53:06.312Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=8981065gitlab # [ 10.255776] gitaly[898]: time="2026-08-20T05:53:06.312Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=8981066gitlab # [ 10.259069] gitaly[898]: time="2026-08-20T05:53:06.312Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=8981067gitlab # [ 10.260672] gitaly[898]: time="2026-08-20T05:53:06.312Z" level=info msg="Starting Gitaly" pid=898 version=1068gitlab # [ 10.429347] gitaly[898]: time="2026-08-20T05:53:06.495Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=182 pid=8981069gitlab # [ 10.431150] gitaly[898]: time="2026-08-20T05:53:06.495Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=8981070gitlab # [ 10.432758] gitaly[898]: time="2026-08-20T05:53:06.495Z" level=info msg="finished initializing command factory" duration_ms=0 pid=8981071gitlab # [ 10.434442] gitaly[898]: time="2026-08-20T05:53:06.496Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-898/git-exec-2846931529.d/git pid=8981072gitlab # [ 10.436558] gitaly[898]: time="2026-08-20T05:53:06.500Z" level=info msg="finished detecting git version" duration_ms=4 pid=8981073gitlab # [ 10.438210] gitaly[898]: time="2026-08-20T05:53:06.500Z" level=info msg="using Git version" pid=898 version=2.53.g1074gitlab # [ 10.439781] gitaly[898]: time="2026-08-20T05:53:06.500Z" level=info msg="clearing disk cache object folder" pid=898 storage=default1075gitlab # [ 10.441429] gitaly[898]: time="2026-08-20T05:53:06.500Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2594423078 pid=898 storage=default1076gitlab # [ 10.443934] gitaly[898]: time="2026-08-20T05:53:06.500Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2594423078 pid=898 storage=default1077gitlab # [ 10.446883] gitaly[898]: time="2026-08-20T05:53:06.500Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=8981078gitlab # [ 10.449491] gitaly[898]: time="2026-08-20T05:53:06.500Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=8981079gitlab # [ 10.452122] gitaly[898]: time="2026-08-20T05:53:06.501Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2594423078 clear_duration_ms=0 pid=898 storage=default1080gitlab # [ 10.469264] gitaly[898]: time="2026-08-20T05:53:06.534Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8981081gitlab # [ 10.469686] gitaly[898]: time="2026-08-20T05:53:06.534Z" level=info msg="counting repositories" pid=8981082gitlab # [ 10.469816] gitaly[898]: time="2026-08-20T05:53:06.534Z" level=info msg="starting to count repositories" pid=898 storage_path=/var/gitlab/state/repositories1083gitlab # [ 10.470514] gitaly[898]: time="2026-08-20T05:53:06.535Z" level=info msg="finished tempdir cleaner walk" pid=898 storage=default time_ms=01084gitlab # [ 10.471055] gitaly[898]: time="2026-08-20T05:53:06.534Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=898 schema=unix1085gitlab # [ 10.471678] gitaly[898]: time="2026-08-20T05:53:06.535Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=898 storage_path=/var/gitlab/state/repositories1086gitlab # [ 10.472182] gitaly[898]: time="2026-08-20T05:53:06.535Z" level=info msg="listening at address" address=/run/gitaly/gitaly-898/sock.d/intern pid=898 schema=unix1087gitlab # [ 10.472688] gitaly[898]: time="2026-08-20T05:53:06.535Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8981088gitlab # [ 10.484026] gitaly[898]: time="2026-08-20T05:53:06.550Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8981089gitlab # [ 10.485765] gitaly[898]: time="2026-08-20T05:53:06.550Z" level=info msg="Started Gitaly" duration_ms=237 pid=8981090gitlab # [ 10.487124] gitaly[898]: time="2026-08-20T05:53:06.550Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8981091gitlab # [ 10.488787] gitaly[898]: time="2026-08-20T05:53:06.550Z" level=info msg="maintenance: daily scheduled" pid=898 scheduled="2026-08-20 12:00:00 +0000 UTC"1092gitlab # [ 11.490585] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1093gitlab # [ 11.491712] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1094gitlab # [ 11.532672] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1095gitlab # [ 12.430344] gitaly[898]: time="2026-08-20T05:53:08.495Z" level=info msg="License database preloaded" duration_ms=2182 pid=8981096gitlab # [ 15.343531] dhcpcd[764]: eth0: leased 10.0.2.15 for 86400 seconds1097gitlab # [ 15.345700] dhcpcd[764]: eth0: adding route to 10.0.2.0/241098gitlab # [ 15.347527] dhcpcd[764]: eth0: adding default route via 10.0.2.21099gitlab # [ 15.441773] systemd[1]: Started DHCP Client.1100gitlab # [ 15.444716] systemd[1]: Reached target Network is Online.1101gitlab # [ 41.558126] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: W, [2026-08-20T05:53:37.623646 #914] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1102gitlab # [ 43.583383] postgres[1315]: [1315] ERROR: relation "feature_gates" does not exist at character 5231103gitlab # [ 43.584070] postgres[1315]: [1315] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1104gitlab # [ 43.584796] postgres[1315]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1105gitlab # [ 43.586843] postgres[1315]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1106gitlab # [ 43.588322] postgres[1315]: attidentity AS identity,1107gitlab # [ 43.589900] postgres[1315]: attgenerated as attgenerated1108gitlab # [ 43.592192] postgres[1315]: FROM pg_attribute a1109gitlab # [ 43.593991] postgres[1315]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1110gitlab # [ 43.595470] postgres[1315]: LEFT JOIN pg_type t ON a.atttypid = t.oid1111gitlab # [ 43.597245] postgres[1315]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1112gitlab # [ 43.599086] postgres[1315]: WHERE a.attrelid = '"feature_gates"'::regclass1113gitlab # [ 43.600477] postgres[1315]: AND a.attnum > 0 AND NOT a.attisdropped1114gitlab # [ 43.602253] postgres[1315]: ORDER BY a.attnum1115gitlab # [ 43.604051] postgres[1315]:1116gitlab # [ 46.921407] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1348]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1117gitlab # [ 46.922305] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1348]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1118gitlab # [ 48.589586] gitlab-workhorse[822]: time="2026-08-20T05:53:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1119gitlab # [ 58.598815] gitlab-workhorse[822]: time="2026-08-20T05:53:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1120gitlab # [ 61.566316] postgres[1414]: [1414] ERROR: relation "table_without_models" does not exist1121gitlab # [ 61.569506] postgres[1414]: [1414] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1122gitlab # [ 68.608115] gitlab-workhorse[822]: time="2026-08-20T05:54:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1123gitlab # [ 72.689539] systemd[1]: Finished gitlab-db-config.service.1124gitlab # [ 72.693983] systemd[1]: Started gitlab-sidekiq.service.1125gitlab # [ 72.697352] systemd[1]: Starting gitlab.service...1126gitlab # [ 73.051128] bundle[1581]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1127gitlab # [ 73.052099] bundle[1581]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1128gitlab # [ 73.052848] bundle[1581]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1129gitlab # [ 75.730204] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-08-20T05:54:11.779Z","message":"Starting cluster with 1 processes"}1130gitlab # [ 75.848124] bundle[1581]: {"timestamp":"2026-08-20T05:54:11.894Z","pid":1581,"message":"* Enabling systemd notification integration"}1131gitlab # [ 75.848766] bundle[1581]: {"timestamp":"2026-08-20T05:54:11.913Z","pid":1581,"message":"Puma starting in cluster mode..."}1132gitlab # [ 75.849651] bundle[1581]: {"timestamp":"2026-08-20T05:54:11.913Z","pid":1581,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1133gitlab # [ 75.850323] bundle[1581]: {"timestamp":"2026-08-20T05:54:11.913Z","pid":1581,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1134gitlab # [ 75.850748] bundle[1581]: {"timestamp":"2026-08-20T05:54:11.913Z","pid":1581,"message":"* Min threads: 0"}1135gitlab # [ 75.851507] bundle[1581]: {"timestamp":"2026-08-20T05:54:11.913Z","pid":1581,"message":"* Max threads: 4"}1136gitlab # [ 75.852170] bundle[1581]: {"timestamp":"2026-08-20T05:54:11.913Z","pid":1581,"message":"* Environment: production"}1137gitlab # [ 75.852851] bundle[1581]: {"timestamp":"2026-08-20T05:54:11.913Z","pid":1581,"message":"* Master PID: 1581"}1138gitlab # [ 75.853633] bundle[1581]: {"timestamp":"2026-08-20T05:54:11.913Z","pid":1581,"message":"* Workers: 2"}1139gitlab # [ 75.854266] bundle[1581]: {"timestamp":"2026-08-20T05:54:11.914Z","pid":1581,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1140gitlab # [ 75.855062] bundle[1581]: {"timestamp":"2026-08-20T05:54:11.914Z","pid":1581,"message":"* Preloading application"}1141gitlab # [ 78.618444] gitlab-workhorse[822]: time="2026-08-20T05:54:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1142gitlab # [ 88.619464] gitlab-workhorse[822]: time="2026-08-20T05:54:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143gitlab # [ 98.545227] bundle[1581]: W, [2026-08-20T05:54:34.610632 #1581] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1144gitlab # [ 98.629155] gitlab-workhorse[822]: time="2026-08-20T05:54:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145gitlab # [ 100.622064] sidekiq-cluster[1611]: 2026-08-20T05:54:36.687Z pid=1611 tid=wkj INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1611, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>450949120}1146gitlab # [ 100.789481] sidekiq-cluster[1611]: W, [2026-08-20T05:54:36.855575 #1611] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1147gitlab # [ 100.832207] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:36.898Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1148gitlab # [ 102.761919] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.827Z","message":"GitLab reliable fetch activated!"}1149gitlab # [ 102.765829] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.827Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1150gitlab # [ 102.784485] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.850Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1151gitlab # [ 102.786740] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.852Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1152gitlab # [ 102.790042] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.856Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1153gitlab # [ 102.792782] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.858Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1154gitlab # [ 102.795757] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.861Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1155gitlab # [ 102.798931] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.865Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1156gitlab # [ 102.801844] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.868Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1157gitlab # [ 102.803909] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.870Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1158gitlab # [ 102.806400] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.872Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1159gitlab # [ 102.808567] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.874Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1160gitlab # [ 102.811190] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.877Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1161gitlab # [ 102.813668] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.879Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1162gitlab # [ 102.816338] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.882Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1163gitlab # [ 102.818527] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.884Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1164gitlab # [ 102.820583] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.886Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1165gitlab # [ 102.823192] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.889Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1166gitlab # [ 102.826221] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.892Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1167gitlab # [ 102.829272] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.895Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1168gitlab # [ 102.832113] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.898Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1169gitlab # [ 102.834816] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.901Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1170gitlab # [ 102.837472] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.903Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1171gitlab # [ 102.839957] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.906Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1172gitlab # [ 102.842489] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.908Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1173gitlab # [ 102.844732] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.910Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1174gitlab # [ 102.847216] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.913Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1175gitlab # [ 102.849772] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.915Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1176gitlab # [ 102.852463] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.918Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1177gitlab # [ 102.854971] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.921Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1178gitlab # [ 102.857579] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.923Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1179gitlab # [ 102.860161] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.926Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1180gitlab # [ 102.862436] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.928Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1181gitlab # [ 102.865345] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.931Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1182gitlab # [ 102.867653] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.933Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1183gitlab # [ 102.870043] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.936Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1184gitlab # [ 102.871878] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.938Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1185gitlab # [ 102.873531] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.939Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1186gitlab # [ 102.875355] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.941Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1187gitlab # [ 102.877384] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.943Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1188gitlab # [ 102.879209] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.945Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1189gitlab # [ 102.881414] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.947Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1190gitlab # [ 102.885967] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.952Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1191gitlab # [ 102.890221] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.956Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1192gitlab # [ 102.894698] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.960Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1193gitlab # [ 102.899383] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.965Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1194gitlab # [ 102.904775] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.971Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1195gitlab # [ 102.909732] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.976Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1196gitlab # [ 102.914423] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.980Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1197gitlab # [ 102.919432] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.985Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1198gitlab # [ 102.925047] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:38.991Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1199gitlab # [ 102.957688] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.023Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1200gitlab # [ 102.961216] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.027Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1201gitlab # [ 102.966767] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.033Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1202gitlab # [ 102.979389] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.045Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1203gitlab # [ 102.985386] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.051Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1204gitlab # [ 102.991498] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.057Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1205gitlab # [ 102.997046] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.063Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1206gitlab # [ 103.003092] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.069Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1207gitlab # [ 103.009450] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.075Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1208gitlab # [ 103.014881] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.081Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1209gitlab # [ 103.021726] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.088Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1210gitlab # [ 103.024296] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.090Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1211gitlab # [ 103.027286] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.093Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1212gitlab # [ 103.030788] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.097Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1213gitlab # [ 103.036575] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.102Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1214gitlab # [ 103.039221] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.105Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1215gitlab # [ 103.043599] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.109Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1216gitlab # [ 103.046767] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.113Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1217gitlab # [ 103.051739] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.118Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1218gitlab # [ 103.055913] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.122Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1219gitlab # [ 103.060039] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.126Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1220gitlab # [ 103.064779] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.131Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1221gitlab # [ 103.068883] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.135Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1222gitlab # [ 103.072947] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.139Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1223gitlab # [ 103.077724] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.144Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1224gitlab # [ 103.081809] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.148Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1225gitlab # [ 103.086788] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.153Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1226gitlab # [ 103.090968] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.157Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1227gitlab # [ 103.096144] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.162Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1228gitlab # [ 103.100227] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.166Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1229gitlab # [ 103.104852] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.171Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1230gitlab # [ 103.109093] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.175Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1231gitlab # [ 103.113381] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.179Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1232gitlab # [ 103.118584] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.184Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1233gitlab # [ 103.123240] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.189Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1234gitlab # [ 103.127702] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.194Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1235gitlab # [ 103.132036] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.198Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1236gitlab # [ 103.137501] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.203Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1237gitlab # [ 103.141664] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.207Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1238gitlab # [ 103.146544] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.212Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1239gitlab # [ 103.150775] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.217Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1240gitlab # [ 103.154873] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.221Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1241gitlab # [ 103.159537] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.225Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1242gitlab # [ 103.163708] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.230Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1243gitlab # [ 103.168176] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.234Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1244gitlab # [ 103.173529] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.239Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1245gitlab # [ 103.178717] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.245Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1246gitlab # [ 103.183342] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.249Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1247gitlab # [ 103.187621] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.253Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1248gitlab # [ 103.197904] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.264Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1249gitlab # [ 103.201350] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.267Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1250gitlab # [ 103.204582] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.270Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1251gitlab # [ 103.208822] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.275Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1252gitlab # [ 103.212368] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.278Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1253gitlab # [ 103.216380] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.282Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1254gitlab # [ 103.220617] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.286Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1255gitlab # [ 103.224036] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.290Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1256gitlab # [ 103.227459] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.293Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1257gitlab # [ 103.231733] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.298Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1258gitlab # [ 103.235137] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:54:39.301Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1259gitlab # [ 108.638663] gitlab-workhorse[822]: time="2026-08-20T05:54:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1260gitlab # [ 118.639763] gitlab-workhorse[822]: time="2026-08-20T05:54:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1261gitlab # [ 128.038968] postgres[2058]: [2058] ERROR: relation "table_without_models" does not exist1262gitlab # [ 128.041732] postgres[2058]: [2058] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1263gitlab # [ 128.641699] gitlab-workhorse[822]: time="2026-08-20T05:55:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1264gitlab # [ 130.114087] postgres[2078]: [2078] ERROR: relation "table_without_models" does not exist1265gitlab # [ 130.114959] postgres[2078]: [2078] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1266gitlab # [ 130.654215] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:06.719Z","message":"Booted Rails 7.2.3.1 application in production environment"}1267gitlab # [ 130.661723] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:06.727Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1268gitlab # [ 130.661862] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:06.728Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1269gitlab # [ 130.663261] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:06.728Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1270gitlab # [ 130.666286] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:06.732Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1271gitlab # [ 132.119157] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:08.184Z","message":"Cleaning working queues"}1272gitlab # [ 132.119635] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:08.185Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"46d0a3a032b54438e0886a96","created_at":"2026-08-20T05:54:08.350Z","trace_propagation_headers":{"sentry-trace":"05e233ef0a114ebcba04e2959e4c41b4-9dca60fc93254104","baggage":"sentry-trace_id=05e233ef0a114ebcba04e2959e4c41b4,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"21daec9003970a07b46c48dcfe442156","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:08.357Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-46d0a3a032b54438e0886a96: start","job_status":"start","queue_duration_s":59.828338,"scheduling_latency_s":59.828382}1273gitlab # [ 132.321496] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:08.387Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"46d0a3a032b54438e0886a96","created_at":"2026-08-20T05:54:08.350Z","trace_propagation_headers":{"sentry-trace":"05e233ef0a114ebcba04e2959e4c41b4-9dca60fc93254104","baggage":"sentry-trace_id=05e233ef0a114ebcba04e2959e4c41b4,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"21daec9003970a07b46c48dcfe442156","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:08.357Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-46d0a3a032b54438e0886a96: done: 0.201548 sec","job_status":"done","queue_duration_s":59.828338,"scheduling_latency_s":59.828382,"redis_calls":31,"redis_duration_s":0.007681,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.00474,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001819,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001122,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.092999809,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.201548,"completed_at":"2026-08-20T05:55:08.387Z","load_balancing_strategy":"primary","db_duration_s":0.04166,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1274gitlab # [ 132.832897] bundle[1581]: {"timestamp":"2026-08-20T05:55:08.898Z","pid":1581,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1275gitlab # [ 132.834192] bundle[1581]: {"timestamp":"2026-08-20T05:55:08.898Z","pid":1581,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1276gitlab # [ 132.835182] bundle[1581]: {"timestamp":"2026-08-20T05:55:08.898Z","pid":1581,"message":"! #\u003cThread:0x00007893fd120db8 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1277gitlab # [ 132.836385] bundle[1581]: {"timestamp":"2026-08-20T05:55:08.898Z","pid":1581,"message":"! #\u003cThread:0x00007893fd321590 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1278gitlab # [ 132.837446] bundle[1581]: {"timestamp":"2026-08-20T05:55:08.898Z","pid":1581,"message":"Use Ctrl-C to stop"}1279gitlab # [ 132.838883] bundle[1581]: {"timestamp":"2026-08-20T05:55:08.899Z","pid":1581,"message":"Sending status to systemd every 1.0 sec"}1280gitlab # [ 133.543429] bundle[1581]: {"timestamp":"2026-08-20T05:55:09.609Z","pid":1581,"message":"- Worker 0 (PID: 2169) booted in 0.66s, phase: 0"}1281gitlab # [ 133.597575] bundle[1581]: {"timestamp":"2026-08-20T05:55:09.663Z","pid":1581,"message":"- Worker 1 (PID: 2173) booted in 0.69s, phase: 0"}1282gitlab # [ 133.604828] systemd[1]: Started gitlab.service.1283gitlab # [ 133.608208] systemd[1]: Reached target Common target for all GitLab services..1284gitlab # [ 133.612224] systemd[1]: Starting setup-gitlab.service...1285gitlab # [ 133.642947] setup-gitlab-start[2206]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1286gitlab # [ 135.731673] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:55:11 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 20521287gitlab # [ 135.738277] setup-gitlab-start[2206]: + TOKEN=nixbot-test-token-of-20-chars1288gitlab # [ 135.740678] setup-gitlab-start[2206]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1289gitlab # [ 135.753376] runuser[2224]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1290gitlab # [ 136.136795] setup-gitlab-start[2225]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1291gitlab # [ 136.141577] setup-gitlab-start[2225]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1292gitlab # [ 136.146335] setup-gitlab-start[2225]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1293gitlab # [ 136.709908] setup-gitlab-start[2225]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1294gitlab # [ 136.714767] setup-gitlab-start[2225]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1295gitlab # [ 136.719195] setup-gitlab-start[2225]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1296gitlab # [ 142.321221] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.386Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"dca20a171484839da0b1567d","created_at":"2026-08-20T05:55:18.355Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"569f84348901ffbcc8538144f44f7b93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.384Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-dca20a171484839da0b1567d: start","job_status":"start","queue_duration_s":0.002274,"scheduling_latency_s":0.002352}1297gitlab # [ 142.433165] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.498Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"dca20a171484839da0b1567d","created_at":"2026-08-20T05:55:18.355Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"569f84348901ffbcc8538144f44f7b93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.384Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-dca20a171484839da0b1567d: done: 0.112232 sec","job_status":"done","queue_duration_s":0.002274,"scheduling_latency_s":0.002352,"redis_calls":19,"redis_duration_s":0.009798,"redis_read_bytes":21,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002393,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000234,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005083,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002088,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000251428,"duration_s":0.112232,"completed_at":"2026-08-20T05:55:18.498Z","load_balancing_strategy":"primary","db_duration_s":0.010536,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 142.435061] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.500Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"718291eaf2c5602af7d46c65","created_at":"2026-08-20T05:55:18.441Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fab67d977123272405bc0ca2515cf27d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.455Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-718291eaf2c5602af7d46c65: start","job_status":"start","queue_duration_s":0.04535,"scheduling_latency_s":0.045366}1299gitlab # [ 142.489796] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.543Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"718291eaf2c5602af7d46c65","created_at":"2026-08-20T05:55:18.441Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fab67d977123272405bc0ca2515cf27d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.455Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-718291eaf2c5602af7d46c65: done: 0.042915 sec","job_status":"done","queue_duration_s":0.04535,"scheduling_latency_s":0.045366,"redis_calls":12,"redis_duration_s":0.024402,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000266,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002041,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.022095,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000952914,"exclusive_lock_hold_duration_s":0.0036093979999999998,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.042915,"completed_at":"2026-08-20T05:55:18.543Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00217,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 142.496858] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.545Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ba70bf4a1459b9e45f9e851c","created_at":"2026-08-20T05:55:18.474Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-4a5fbf7a526e442f","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"569f84348901ffbcc8538144f44f7b93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.493Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ba70bf4a1459b9e45f9e851c: start","job_status":"start","queue_duration_s":0.052817,"scheduling_latency_s":0.052832}1301gitlab # [ 142.571189] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.637Z","message":"No existing merge request to be cleaned up."}1302gitlab # [ 142.604437] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.670Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ba70bf4a1459b9e45f9e851c","created_at":"2026-08-20T05:55:18.474Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-4a5fbf7a526e442f","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"569f84348901ffbcc8538144f44f7b93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.493Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ba70bf4a1459b9e45f9e851c: done: 0.124337 sec","job_status":"done","queue_duration_s":0.052817,"scheduling_latency_s":0.052832,"redis_calls":13,"redis_duration_s":0.035979,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001846,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.017961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.016172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.019,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.019,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000746464,"duration_s":0.124337,"completed_at":"2026-08-20T05:55:18.670Z","load_balancing_strategy":"primary","db_duration_s":0.032311,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 142.605699] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.671Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e92b343a0cdb74ae9e4533ea","created_at":"2026-08-20T05:55:18.474Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-4a5fbf7a526e442f","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"569f84348901ffbcc8538144f44f7b93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.493Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e92b343a0cdb74ae9e4533ea: start","job_status":"start","queue_duration_s":0.178585,"scheduling_latency_s":0.178602}1304gitlab # [ 142.613305] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.679Z","message":"No existing merge request to be cleaned up."}1305gitlab # [ 142.619762] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.685Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e92b343a0cdb74ae9e4533ea","created_at":"2026-08-20T05:55:18.474Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-4a5fbf7a526e442f","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"569f84348901ffbcc8538144f44f7b93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.493Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e92b343a0cdb74ae9e4533ea: done: 0.014238 sec","job_status":"done","queue_duration_s":0.178585,"scheduling_latency_s":0.178602,"redis_calls":10,"redis_duration_s":0.001389,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000835,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014238,"completed_at":"2026-08-20T05:55:18.685Z","load_balancing_strategy":"primary","db_duration_s":0.00148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 142.667463] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.686Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a51d5653a537d328e91717fb","created_at":"2026-08-20T05:55:18.474Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-4a5fbf7a526e442f","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"569f84348901ffbcc8538144f44f7b93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.493Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a51d5653a537d328e91717fb: start","job_status":"start","queue_duration_s":0.193744,"scheduling_latency_s":0.193759}1307gitlab # [ 142.668266] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.697Z","message":"No existing merge request to be cleaned up."}1308gitlab # [ 142.668928] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.703Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a51d5653a537d328e91717fb","created_at":"2026-08-20T05:55:18.474Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-4a5fbf7a526e442f","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"569f84348901ffbcc8538144f44f7b93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.493Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a51d5653a537d328e91717fb: done: 0.016771 sec","job_status":"done","queue_duration_s":0.193744,"scheduling_latency_s":0.193759,"redis_calls":10,"redis_duration_s":0.001677,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016771,"completed_at":"2026-08-20T05:55:18.703Z","load_balancing_strategy":"primary","db_duration_s":0.006424,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 142.714758] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.704Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bf9556d217782cc78bb3e850","created_at":"2026-08-20T05:55:18.474Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-4a5fbf7a526e442f","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"569f84348901ffbcc8538144f44f7b93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.493Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bf9556d217782cc78bb3e850: start","job_status":"start","queue_duration_s":0.211627,"scheduling_latency_s":0.211643}1310gitlab # [ 142.715602] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.712Z","message":"No existing merge request to be cleaned up."}1311gitlab # [ 142.716574] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.718Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bf9556d217782cc78bb3e850","created_at":"2026-08-20T05:55:18.474Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-4a5fbf7a526e442f","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"569f84348901ffbcc8538144f44f7b93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.493Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bf9556d217782cc78bb3e850: done: 0.013384 sec","job_status":"done","queue_duration_s":0.211627,"scheduling_latency_s":0.211643,"redis_calls":10,"redis_duration_s":0.0013640000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000796,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013384,"completed_at":"2026-08-20T05:55:18.717Z","load_balancing_strategy":"primary","db_duration_s":0.001232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 142.730454] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.719Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4001195db3d4720ad9c7f644","created_at":"2026-08-20T05:55:18.470Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6661ea852c37e96a914d784560bd3591","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.512Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4001195db3d4720ad9c7f644: start","job_status":"start","queue_duration_s":0.206658,"scheduling_latency_s":0.206676}1313gitlab # [ 142.774799] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.745Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4001195db3d4720ad9c7f644","created_at":"2026-08-20T05:55:18.470Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6661ea852c37e96a914d784560bd3591","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.512Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4001195db3d4720ad9c7f644: done: 0.026268 sec","job_status":"done","queue_duration_s":0.206658,"scheduling_latency_s":0.206676,"redis_calls":13,"redis_duration_s":0.002015,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000423,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000634,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.009718553,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.026268,"completed_at":"2026-08-20T05:55:18.745Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004664,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1314gitlab # [ 142.777316] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.746Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"78370fb777dd8c4d874deabb","created_at":"2026-08-20T05:55:18.533Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd94253e58bcc896e51684335a2d321b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.544Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-78370fb777dd8c4d874deabb: start","job_status":"start","queue_duration_s":0.202206,"scheduling_latency_s":0.202223}1315gitlab # [ 142.792217] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.755Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1316gitlab # [ 142.793093] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.760Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"78370fb777dd8c4d874deabb","created_at":"2026-08-20T05:55:18.533Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd94253e58bcc896e51684335a2d321b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.544Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-78370fb777dd8c4d874deabb: done: 0.014326 sec","job_status":"done","queue_duration_s":0.202206,"scheduling_latency_s":0.202223,"redis_calls":10,"redis_duration_s":0.001518,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000298,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000237181,"duration_s":0.014326,"completed_at":"2026-08-20T05:55:18.760Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000399,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 142.851892] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.762Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"21292fed1a2671b6348d6620","created_at":"2026-08-20T05:55:18.548Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66950c4cffcd380e8c7ac127efd4a100","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:55:18.562Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-21292fed1a2671b6348d6620: start","job_status":"start","queue_duration_s":0.199683,"scheduling_latency_s":0.199698}1318gitlab # [ 142.852589] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.770Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1319gitlab # [ 142.853305] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.775Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"21292fed1a2671b6348d6620","created_at":"2026-08-20T05:55:18.548Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66950c4cffcd380e8c7ac127efd4a100","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:55:18.562Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-21292fed1a2671b6348d6620: done: 0.013912 sec","job_status":"done","queue_duration_s":0.199683,"scheduling_latency_s":0.199698,"redis_calls":10,"redis_duration_s":0.00157,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000269,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000292216,"duration_s":0.013912,"completed_at":"2026-08-20T05:55:18.775Z","load_balancing_strategy":"primary","db_duration_s":0.000444,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 142.888626] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.777Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"104ec5a9c047094d74463f2b","created_at":"2026-08-20T05:55:18.572Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0488a35b70ef9405c62cab6bf4ed33ed","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.583Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-104ec5a9c047094d74463f2b: start","job_status":"start","queue_duration_s":0.193357,"scheduling_latency_s":0.193372}1321gitlab # [ 142.889333] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.802Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"104ec5a9c047094d74463f2b","created_at":"2026-08-20T05:55:18.572Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0488a35b70ef9405c62cab6bf4ed33ed","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.583Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-104ec5a9c047094d74463f2b: done: 0.025041 sec","job_status":"done","queue_duration_s":0.193357,"scheduling_latency_s":0.193372,"redis_calls":12,"redis_duration_s":0.001951,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000442,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000863,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000646,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00040452,"exclusive_lock_hold_duration_s":0.00878743,"duration_s":0.025041,"completed_at":"2026-08-20T05:55:18.802Z","load_balancing_strategy":"primary","db_duration_s":0.007569,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 142.926628] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.803Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"fdbe63a6e45108ccb70a1116","created_at":"2026-08-20T05:55:18.603Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4f2b07294054ddfd9b02fe93761a1a1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.616Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-fdbe63a6e45108ccb70a1116: start","job_status":"start","queue_duration_s":0.187218,"scheduling_latency_s":0.187233}1323gitlab # [ 142.927269] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.811Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1324gitlab # [ 142.929321] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.818Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"fdbe63a6e45108ccb70a1116","created_at":"2026-08-20T05:55:18.603Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4f2b07294054ddfd9b02fe93761a1a1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.616Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-fdbe63a6e45108ccb70a1116: done: 0.015137 sec","job_status":"done","queue_duration_s":0.187218,"scheduling_latency_s":0.187233,"redis_calls":10,"redis_duration_s":0.001311,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000234666,"duration_s":0.015137,"completed_at":"2026-08-20T05:55:18.818Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000391,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 142.985685] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.819Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"559a7744cc56adc29a0f3a9a","created_at":"2026-08-20T05:55:18.633Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a14eda4115468b0b4dedeea9ddfd77d0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.644Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-559a7744cc56adc29a0f3a9a: start","job_status":"start","queue_duration_s":0.175116,"scheduling_latency_s":0.175131}1326gitlab # [ 142.986496] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.837Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"559a7744cc56adc29a0f3a9a","created_at":"2026-08-20T05:55:18.633Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a14eda4115468b0b4dedeea9ddfd77d0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.644Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-559a7744cc56adc29a0f3a9a: done: 0.018001 sec","job_status":"done","queue_duration_s":0.175116,"scheduling_latency_s":0.175131,"redis_calls":10,"redis_duration_s":0.001381,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000329,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023746,"duration_s":0.018001,"completed_at":"2026-08-20T05:55:18.837Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002653,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 143.022696] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"60e37bb3f6cd49e0b9ae3bcf","created_at":"2026-08-20T05:55:18.661Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3470068ba33b07228cac1e4958d0bfe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.669Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-60e37bb3f6cd49e0b9ae3bcf: start","job_status":"start","queue_duration_s":0.16953,"scheduling_latency_s":0.169546}1328gitlab # [ 143.023556] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:18.901Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"60e37bb3f6cd49e0b9ae3bcf","created_at":"2026-08-20T05:55:18.661Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3470068ba33b07228cac1e4958d0bfe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:18.669Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-60e37bb3f6cd49e0b9ae3bcf: done: 0.062949 sec","job_status":"done","queue_duration_s":0.16953,"scheduling_latency_s":0.169546,"redis_calls":12,"redis_duration_s":0.002013,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000289,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000773,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000628572,"exclusive_lock_hold_duration_s":0.023080866999999998,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.062949,"completed_at":"2026-08-20T05:55:18.901Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026799,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 143.105220] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:19.171Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"eac91c1b523333418b53f726","created_at":"2026-08-20T05:55:19.162Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc19c25fb7f5a42d342b6bf34dca7e20","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.169Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-eac91c1b523333418b53f726: start","job_status":"start","queue_duration_s":0.001761,"scheduling_latency_s":0.001785}1330gitlab # [ 143.182712] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:19.248Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"eac91c1b523333418b53f726","created_at":"2026-08-20T05:55:19.162Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc19c25fb7f5a42d342b6bf34dca7e20","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.169Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-eac91c1b523333418b53f726: done: 0.077058 sec","job_status":"done","queue_duration_s":0.001761,"scheduling_latency_s":0.001785,"redis_calls":10,"redis_duration_s":0.006837,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000835,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004949,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000502578,"duration_s":0.077058,"completed_at":"2026-08-20T05:55:19.247Z","load_balancing_strategy":"primary","db_duration_s":0.018242,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 143.225125] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:19.290Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a55e21ec021079b818e3764c","created_at":"2026-08-20T05:55:19.187Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ce26aea8fc3e6ae8f973205a6a3fa46","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.198Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a55e21ec021079b818e3764c: start","job_status":"start","queue_duration_s":0.092328,"scheduling_latency_s":0.092368}1332gitlab # [ 143.279739] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:19.345Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a55e21ec021079b818e3764c","created_at":"2026-08-20T05:55:19.187Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ce26aea8fc3e6ae8f973205a6a3fa46","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.198Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a55e21ec021079b818e3764c: done: 0.054158 sec","job_status":"done","queue_duration_s":0.092328,"scheduling_latency_s":0.092368,"redis_calls":12,"redis_duration_s":0.008754999999999999,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003763,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003666,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001326,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000500343,"duration_s":0.054158,"completed_at":"2026-08-20T05:55:19.344Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003028,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 143.317780] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:19.383Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"acb8cdaadb4d27353491af5a","created_at":"2026-08-20T05:55:19.218Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.229Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-acb8cdaadb4d27353491af5a: start","job_status":"start","queue_duration_s":0.154556,"scheduling_latency_s":0.154598}1334gitlab # [ 143.610504] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:19.675Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"acb8cdaadb4d27353491af5a","created_at":"2026-08-20T05:55:19.218Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.229Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-acb8cdaadb4d27353491af5a: done: 0.291932 sec","job_status":"done","queue_duration_s":0.154556,"scheduling_latency_s":0.154598,"redis_calls":71,"redis_duration_s":0.08923,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.008432,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000779,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.078034,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001985,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.1292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000585829,"duration_s":0.291932,"completed_at":"2026-08-20T05:55:19.675Z","load_balancing_strategy":"primary","db_duration_s":0.00999,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 143.659276] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:19.725Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"c183578b44883323d1303e28","created_at":"2026-08-20T05:55:19.244Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.295Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-c183578b44883323d1303e28: start","job_status":"start","queue_duration_s":0.429709,"scheduling_latency_s":0.429754}1336gitlab # [ 143.735454] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:19.800Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"c183578b44883323d1303e28","created_at":"2026-08-20T05:55:19.244Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.295Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-c183578b44883323d1303e28: done: 0.075975 sec","job_status":"done","queue_duration_s":0.429709,"scheduling_latency_s":0.429754,"redis_calls":28,"redis_duration_s":0.007443,"redis_read_bytes":36,"redis_write_bytes":10603,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000878,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000622,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8315,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.00461,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001333,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000489727,"duration_s":0.075975,"completed_at":"2026-08-20T05:55:19.800Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004848,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 143.793857] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:19.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a5fe875284888bccd0abb44b","created_at":"2026-08-20T05:55:19.315Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"63337bea3135018c7f544d77bf7a8404","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.328Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a5fe875284888bccd0abb44b: start","job_status":"start","queue_duration_s":0.531361,"scheduling_latency_s":0.531406}1338gitlab # [ 143.984690] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.050Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a5fe875284888bccd0abb44b","created_at":"2026-08-20T05:55:19.315Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"63337bea3135018c7f544d77bf7a8404","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.328Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a5fe875284888bccd0abb44b: done: 0.190574 sec","job_status":"done","queue_duration_s":0.531361,"scheduling_latency_s":0.531406,"redis_calls":14,"redis_duration_s":0.003436,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000838,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001392,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001206,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.032,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.132485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000697575,"exclusive_lock_hold_duration_s":0.15424586199999998,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.190574,"completed_at":"2026-08-20T05:55:20.050Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.050138,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 144.061094] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.127Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"1ee7bad4edd622a000ce260a","created_at":"2026-08-20T05:55:19.340Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7f0280f12218e761ddb08f2df8a8dd2","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.385Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-1ee7bad4edd622a000ce260a: start","job_status":"start","queue_duration_s":0.741299,"scheduling_latency_s":0.741331}1340gitlab # [ 144.118626] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.183Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"1ee7bad4edd622a000ce260a","created_at":"2026-08-20T05:55:19.340Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7f0280f12218e761ddb08f2df8a8dd2","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.385Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-1ee7bad4edd622a000ce260a: done: 0.056936 sec","job_status":"done","queue_duration_s":0.741299,"scheduling_latency_s":0.741331,"redis_calls":16,"redis_duration_s":0.003807,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001649,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001658,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0005,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047967,"duration_s":0.056936,"completed_at":"2026-08-20T05:55:20.183Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00623,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 144.164138] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.229Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3496875c67ea884b20a11db1","created_at":"2026-08-20T05:55:19.404Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"660e868f49754b56f327fa04e959c84f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.419Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3496875c67ea884b20a11db1: start","job_status":"start","queue_duration_s":0.810679,"scheduling_latency_s":0.810735}1342gitlab # [ 144.462271] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.528Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3496875c67ea884b20a11db1","created_at":"2026-08-20T05:55:19.404Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"660e868f49754b56f327fa04e959c84f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.419Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3496875c67ea884b20a11db1: done: 0.298181 sec","job_status":"done","queue_duration_s":0.810679,"scheduling_latency_s":0.810735,"redis_calls":565,"redis_duration_s":0.102741,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000688,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00152,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.100533,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.208605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000285511,"duration_s":0.298181,"completed_at":"2026-08-20T05:55:20.527Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000715,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 144.535369] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.529Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9a3c059c945072394398dc19","created_at":"2026-08-20T05:55:19.429Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ec992882b21206daa27d62dd1a238c8","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.442Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9a3c059c945072394398dc19: start","job_status":"start","queue_duration_s":1.087545,"scheduling_latency_s":1.087561}1344gitlab # [ 144.546835] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.568Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9a3c059c945072394398dc19","created_at":"2026-08-20T05:55:19.429Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ec992882b21206daa27d62dd1a238c8","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.442Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9a3c059c945072394398dc19: done: 0.038635 sec","job_status":"done","queue_duration_s":1.087545,"scheduling_latency_s":1.087561,"redis_calls":10,"redis_duration_s":0.002365,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000454,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001491,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00042,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000459835,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.038635,"completed_at":"2026-08-20T05:55:20.568Z","load_balancing_strategy":"primary","db_duration_s":0.017147,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 144.584753] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.570Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3eef90788e01a4ec2af02752","created_at":"2026-08-20T05:55:19.482Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5c9ebac59ecbb5066aa948b001b8f16","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.494Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3eef90788e01a4ec2af02752: start","job_status":"start","queue_duration_s":1.076021,"scheduling_latency_s":1.076046}1346gitlab # [ 144.596684] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.599Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3eef90788e01a4ec2af02752","created_at":"2026-08-20T05:55:19.482Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5c9ebac59ecbb5066aa948b001b8f16","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.494Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3eef90788e01a4ec2af02752: done: 0.029334 sec","job_status":"done","queue_duration_s":1.076021,"scheduling_latency_s":1.076046,"redis_calls":12,"redis_duration_s":0.001794,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00065,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00032127,"exclusive_lock_hold_duration_s":0.0114495,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.029334,"completed_at":"2026-08-20T05:55:20.599Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005696,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 144.633614] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.600Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"506f6ec48a170e2ca2973dc5","created_at":"2026-08-20T05:55:19.507Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3093c39c235d87e900a2fe05b7438041","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.523Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-506f6ec48a170e2ca2973dc5: start","job_status":"start","queue_duration_s":1.077193,"scheduling_latency_s":1.077207}1348gitlab # [ 144.645429] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.626Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"506f6ec48a170e2ca2973dc5","created_at":"2026-08-20T05:55:19.507Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3093c39c235d87e900a2fe05b7438041","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.523Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-506f6ec48a170e2ca2973dc5: done: 0.025661 sec","job_status":"done","queue_duration_s":1.077193,"scheduling_latency_s":1.077207,"redis_calls":11,"redis_duration_s":0.001469,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000219,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000191365,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.025661,"completed_at":"2026-08-20T05:55:20.625Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 144.646248] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.626Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4e7dd785f4629f4cfcd0a46d","created_at":"2026-08-20T05:55:19.534Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da903ffa81ac4f03e24883bdaefddba6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.546Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4e7dd785f4629f4cfcd0a46d: start","job_status":"start","queue_duration_s":1.080078,"scheduling_latency_s":1.080091}1350gitlab # [ 144.683612] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.634Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1351gitlab # [ 144.684209] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.639Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4e7dd785f4629f4cfcd0a46d","created_at":"2026-08-20T05:55:19.534Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da903ffa81ac4f03e24883bdaefddba6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.546Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4e7dd785f4629f4cfcd0a46d: done: 0.01218 sec","job_status":"done","queue_duration_s":1.080078,"scheduling_latency_s":1.080091,"redis_calls":10,"redis_duration_s":0.0012720000000000001,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000243,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000318,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194997,"duration_s":0.01218,"completed_at":"2026-08-20T05:55:20.639Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 144.693763] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.640Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"97e1575af3dab4e9013be290","created_at":"2026-08-20T05:55:19.562Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cbaaf7550d20268b8804ec453b1628fb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.575Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-97e1575af3dab4e9013be290: start","job_status":"start","queue_duration_s":1.064448,"scheduling_latency_s":1.064462}1353gitlab # [ 144.738857] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.652Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"97e1575af3dab4e9013be290","created_at":"2026-08-20T05:55:19.562Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cbaaf7550d20268b8804ec453b1628fb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.575Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-97e1575af3dab4e9013be290: done: 0.012431 sec","job_status":"done","queue_duration_s":1.064448,"scheduling_latency_s":1.064462,"redis_calls":10,"redis_duration_s":0.001244,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000259809,"duration_s":0.012431,"completed_at":"2026-08-20T05:55:20.652Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000218,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 144.740388] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.653Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a9246c85891eebf759e943d3","created_at":"2026-08-20T05:55:19.586Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f5e996a1e248ec0694911a5f649b06c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:55:19.599Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a9246c85891eebf759e943d3: start","job_status":"start","queue_duration_s":1.053975,"scheduling_latency_s":1.05399}1355gitlab # [ 144.750867] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.663Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1356gitlab # [ 144.787512] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.668Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a9246c85891eebf759e943d3","created_at":"2026-08-20T05:55:19.586Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f5e996a1e248ec0694911a5f649b06c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:55:19.599Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a9246c85891eebf759e943d3: done: 0.014769 sec","job_status":"done","queue_duration_s":1.053975,"scheduling_latency_s":1.05399,"redis_calls":10,"redis_duration_s":0.001425,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000303,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024612,"duration_s":0.014769,"completed_at":"2026-08-20T05:55:20.668Z","load_balancing_strategy":"primary","db_duration_s":0.002444,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 144.788988] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.669Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"4e079d94329c297f4b0b0f80","created_at":"2026-08-20T05:55:19.615Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b642c989bd291c0c5e0502b77838e693","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.627Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-4e079d94329c297f4b0b0f80: start","job_status":"start","queue_duration_s":1.04177,"scheduling_latency_s":1.041783}1358gitlab # [ 144.826258] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.676Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1359gitlab # [ 144.826955] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.680Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"4e079d94329c297f4b0b0f80","created_at":"2026-08-20T05:55:19.615Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b642c989bd291c0c5e0502b77838e693","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.627Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-4e079d94329c297f4b0b0f80: done: 0.011485 sec","job_status":"done","queue_duration_s":1.04177,"scheduling_latency_s":1.041783,"redis_calls":10,"redis_duration_s":0.001233,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194717,"duration_s":0.011485,"completed_at":"2026-08-20T05:55:20.680Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000299,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 144.835099] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.681Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"3b06794255df34a056f22462","created_at":"2026-08-20T05:55:19.633Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06b17ed27c91f569d0591a796e0743f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:55:19.641Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-3b06794255df34a056f22462: start","job_status":"start","queue_duration_s":1.040322,"scheduling_latency_s":1.040337}1361gitlab # [ 144.846339] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.700Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"3b06794255df34a056f22462","created_at":"2026-08-20T05:55:19.633Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06b17ed27c91f569d0591a796e0743f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:55:19.641Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-3b06794255df34a056f22462: done: 0.018826 sec","job_status":"done","queue_duration_s":1.040322,"scheduling_latency_s":1.040337,"redis_calls":10,"redis_duration_s":0.001243,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203657,"duration_s":0.018826,"completed_at":"2026-08-20T05:55:20.700Z","load_balancing_strategy":"primary","db_duration_s":0.00227,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 144.888159] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc22ec6a8f9699571efbbb07","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc22ec6a8f9699571efbbb07: start","job_status":"start","queue_duration_s":1.036563,"scheduling_latency_s":1.036577}1363gitlab # [ 144.932048] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:20.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc22ec6a8f9699571efbbb07","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc22ec6a8f9699571efbbb07: done: 0.296221 sec","job_status":"done","queue_duration_s":1.036563,"scheduling_latency_s":1.036577,"redis_calls":16,"redis_duration_s":0.002725,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001444,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000426869,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.296221,"completed_at":"2026-08-20T05:55:20.997Z","load_balancing_strategy":"primary","db_duration_s":0.000233,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 144.965723] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9572dea571ce3cc65dec4c6d","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9572dea571ce3cc65dec4c6d: start","job_status":"start","queue_duration_s":1.366799,"scheduling_latency_s":1.366826}1365gitlab # [ 144.995812] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9572dea571ce3cc65dec4c6d","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9572dea571ce3cc65dec4c6d: done: 0.029314 sec","job_status":"done","queue_duration_s":1.366799,"scheduling_latency_s":1.366826,"redis_calls":13,"redis_duration_s":0.003075,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001081,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029314,"completed_at":"2026-08-20T05:55:21.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 145.028655] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"916f8e4d07dbd3a01ccc42cc","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-916f8e4d07dbd3a01ccc42cc: start","job_status":"start","queue_duration_s":1.429545,"scheduling_latency_s":1.429584}1367gitlab # [ 145.053483] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"916f8e4d07dbd3a01ccc42cc","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-916f8e4d07dbd3a01ccc42cc: done: 0.024455 sec","job_status":"done","queue_duration_s":1.429545,"scheduling_latency_s":1.429584,"redis_calls":13,"redis_duration_s":0.003667,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001286,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002381,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024455,"completed_at":"2026-08-20T05:55:21.118Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 145.086376] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51be5e3f790b1ef88bbf9015","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51be5e3f790b1ef88bbf9015: start","job_status":"start","queue_duration_s":1.487143,"scheduling_latency_s":1.487182}1369gitlab # [ 145.117949] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51be5e3f790b1ef88bbf9015","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51be5e3f790b1ef88bbf9015: done: 0.031163 sec","job_status":"done","queue_duration_s":1.487143,"scheduling_latency_s":1.487182,"redis_calls":13,"redis_duration_s":0.002556,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031163,"completed_at":"2026-08-20T05:55:21.183Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 145.150397] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0b0162bf9e234712f7c2d52","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0b0162bf9e234712f7c2d52: start","job_status":"start","queue_duration_s":1.551177,"scheduling_latency_s":1.551215}1371gitlab # [ 145.182362] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0b0162bf9e234712f7c2d52","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0b0162bf9e234712f7c2d52: done: 0.031609 sec","job_status":"done","queue_duration_s":1.551177,"scheduling_latency_s":1.551215,"redis_calls":13,"redis_duration_s":0.0029130000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031609,"completed_at":"2026-08-20T05:55:21.247Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 145.184339] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"006dbb9a7a8d7182f9b0c761","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-006dbb9a7a8d7182f9b0c761: start","job_status":"start","queue_duration_s":1.585267,"scheduling_latency_s":1.585299}1373gitlab # [ 145.205981] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"006dbb9a7a8d7182f9b0c761","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-006dbb9a7a8d7182f9b0c761: done: 0.02152 sec","job_status":"done","queue_duration_s":1.585267,"scheduling_latency_s":1.585299,"redis_calls":13,"redis_duration_s":0.00233,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000759,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001571,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01516,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02152,"completed_at":"2026-08-20T05:55:21.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 145.242203] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1433ce899c31a3f1b38092e","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1433ce899c31a3f1b38092e: start","job_status":"start","queue_duration_s":1.608492,"scheduling_latency_s":1.608523}1375gitlab # [ 145.243196] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1433ce899c31a3f1b38092e","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1433ce899c31a3f1b38092e: done: 0.019417 sec","job_status":"done","queue_duration_s":1.608492,"scheduling_latency_s":1.608523,"redis_calls":13,"redis_duration_s":0.002076,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000695,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001381,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019417,"completed_at":"2026-08-20T05:55:21.292Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 145.291687] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce564c34ea028fa39e9eef69","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce564c34ea028fa39e9eef69: start","job_status":"start","queue_duration_s":1.629133,"scheduling_latency_s":1.629147}1377gitlab # [ 145.292674] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce564c34ea028fa39e9eef69","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce564c34ea028fa39e9eef69: done: 0.009973 sec","job_status":"done","queue_duration_s":1.629133,"scheduling_latency_s":1.629147,"redis_calls":13,"redis_duration_s":0.001605,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009973,"completed_at":"2026-08-20T05:55:21.304Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 145.304751] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98e9b6cc974d583233904f77","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98e9b6cc974d583233904f77: start","job_status":"start","queue_duration_s":1.639906,"scheduling_latency_s":1.640074}1379gitlab # [ 145.315777] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98e9b6cc974d583233904f77","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98e9b6cc974d583233904f77: done: 0.009908 sec","job_status":"done","queue_duration_s":1.639906,"scheduling_latency_s":1.640074,"redis_calls":13,"redis_duration_s":0.001468,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009908,"completed_at":"2026-08-20T05:55:21.314Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 145.351613] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9824894e527476fe6b7621fe","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9824894e527476fe6b7621fe: start","job_status":"start","queue_duration_s":1.650647,"scheduling_latency_s":1.650661}1381gitlab # [ 145.357586] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9824894e527476fe6b7621fe","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9824894e527476fe6b7621fe: done: 0.009879 sec","job_status":"done","queue_duration_s":1.650647,"scheduling_latency_s":1.650661,"redis_calls":13,"redis_duration_s":0.001493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009879,"completed_at":"2026-08-20T05:55:21.325Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 145.402627] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea0383cc1d21ab0d4bea2e32","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea0383cc1d21ab0d4bea2e32: start","job_status":"start","queue_duration_s":1.661328,"scheduling_latency_s":1.661341}1383gitlab # [ 145.403677] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea0383cc1d21ab0d4bea2e32","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea0383cc1d21ab0d4bea2e32: done: 0.010072 sec","job_status":"done","queue_duration_s":1.661328,"scheduling_latency_s":1.661341,"redis_calls":13,"redis_duration_s":0.001453,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010072,"completed_at":"2026-08-20T05:55:21.336Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 145.442086] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e1a846f347572ff5feb42d4","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e1a846f347572ff5feb42d4: start","job_status":"start","queue_duration_s":1.672233,"scheduling_latency_s":1.672247}1385gitlab # [ 145.442857] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e1a846f347572ff5feb42d4","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e1a846f347572ff5feb42d4: done: 0.00982 sec","job_status":"done","queue_duration_s":1.672233,"scheduling_latency_s":1.672247,"redis_calls":13,"redis_duration_s":0.0016259999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000633,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00982,"completed_at":"2026-08-20T05:55:21.347Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 145.493614] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e67519cc81d38f109fc3cc3","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e67519cc81d38f109fc3cc3: start","job_status":"start","queue_duration_s":1.683025,"scheduling_latency_s":1.683039}1387gitlab # [ 145.494659] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e67519cc81d38f109fc3cc3","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e67519cc81d38f109fc3cc3: done: 0.009871 sec","job_status":"done","queue_duration_s":1.683025,"scheduling_latency_s":1.683039,"redis_calls":13,"redis_duration_s":0.001643,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009871,"completed_at":"2026-08-20T05:55:21.357Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 145.518208] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55a11a9706e275c96c864623","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55a11a9706e275c96c864623: start","job_status":"start","queue_duration_s":1.693859,"scheduling_latency_s":1.693873}1389gitlab # [ 145.555909] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55a11a9706e275c96c864623","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55a11a9706e275c96c864623: done: 0.009583 sec","job_status":"done","queue_duration_s":1.693859,"scheduling_latency_s":1.693873,"redis_calls":13,"redis_duration_s":0.001499,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009583,"completed_at":"2026-08-20T05:55:21.368Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 145.592414] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1791359c974f3ac43a7c515","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1791359c974f3ac43a7c515: start","job_status":"start","queue_duration_s":1.704451,"scheduling_latency_s":1.704465}1391gitlab # [ 145.593381] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1791359c974f3ac43a7c515","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1791359c974f3ac43a7c515: done: 0.009766 sec","job_status":"done","queue_duration_s":1.704451,"scheduling_latency_s":1.704465,"redis_calls":13,"redis_duration_s":0.001449,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009766,"completed_at":"2026-08-20T05:55:21.379Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 145.636339] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2251d6af6925900531759e1","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2251d6af6925900531759e1: start","job_status":"start","queue_duration_s":1.715146,"scheduling_latency_s":1.715159}1393gitlab # [ 145.637229] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2251d6af6925900531759e1","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2251d6af6925900531759e1: done: 0.009677 sec","job_status":"done","queue_duration_s":1.715146,"scheduling_latency_s":1.715159,"redis_calls":13,"redis_duration_s":0.001439,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009677,"completed_at":"2026-08-20T05:55:21.389Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 145.645091] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8def713181d8d7d2027b685","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8def713181d8d7d2027b685: start","job_status":"start","queue_duration_s":1.72582,"scheduling_latency_s":1.725833}1395gitlab # [ 145.656063] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8def713181d8d7d2027b685","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8def713181d8d7d2027b685: done: 0.009714 sec","job_status":"done","queue_duration_s":1.72582,"scheduling_latency_s":1.725833,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009714,"completed_at":"2026-08-20T05:55:21.400Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 145.692711] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"154571efc1909eb784a53ecc","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-154571efc1909eb784a53ecc: start","job_status":"start","queue_duration_s":1.73632,"scheduling_latency_s":1.736333}1397gitlab # [ 145.731101] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"154571efc1909eb784a53ecc","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-154571efc1909eb784a53ecc: done: 0.009914 sec","job_status":"done","queue_duration_s":1.73632,"scheduling_latency_s":1.736333,"redis_calls":13,"redis_duration_s":0.001697,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009914,"completed_at":"2026-08-20T05:55:21.411Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 145.732455] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1560b0b34cde67b7a2748b8c","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1560b0b34cde67b7a2748b8c: start","job_status":"start","queue_duration_s":1.747224,"scheduling_latency_s":1.747237}1399gitlab # [ 145.770135] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1560b0b34cde67b7a2748b8c","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1560b0b34cde67b7a2748b8c: done: 0.009796 sec","job_status":"done","queue_duration_s":1.747224,"scheduling_latency_s":1.747237,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009796,"completed_at":"2026-08-20T05:55:21.421Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 145.771047] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecdb24fc73a1dc81767e4ffb","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecdb24fc73a1dc81767e4ffb: start","job_status":"start","queue_duration_s":1.75784,"scheduling_latency_s":1.757854}1401gitlab # [ 145.813097] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecdb24fc73a1dc81767e4ffb","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecdb24fc73a1dc81767e4ffb: done: 0.009772 sec","job_status":"done","queue_duration_s":1.75784,"scheduling_latency_s":1.757854,"redis_calls":13,"redis_duration_s":0.00166,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009772,"completed_at":"2026-08-20T05:55:21.432Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 145.814043] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"830362c6aadb7b7ad6546e40","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-830362c6aadb7b7ad6546e40: start","job_status":"start","queue_duration_s":1.76841,"scheduling_latency_s":1.76845}1403gitlab # [ 145.821979] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"830362c6aadb7b7ad6546e40","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-830362c6aadb7b7ad6546e40: done: 0.009728 sec","job_status":"done","queue_duration_s":1.76841,"scheduling_latency_s":1.76845,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009728,"completed_at":"2026-08-20T05:55:21.443Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 145.857996] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"556183e77fbf7078201967c5","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-556183e77fbf7078201967c5: start","job_status":"start","queue_duration_s":1.778936,"scheduling_latency_s":1.77895}1405gitlab # [ 145.864023] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"556183e77fbf7078201967c5","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-556183e77fbf7078201967c5: done: 0.010097 sec","job_status":"done","queue_duration_s":1.778936,"scheduling_latency_s":1.77895,"redis_calls":13,"redis_duration_s":0.001687,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001171,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010097,"completed_at":"2026-08-20T05:55:21.453Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 145.899432] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f5c6ba0bdb050bf72cfea9f","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f5c6ba0bdb050bf72cfea9f: start","job_status":"start","queue_duration_s":1.789875,"scheduling_latency_s":1.789888}1407gitlab # [ 145.905413] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f5c6ba0bdb050bf72cfea9f","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f5c6ba0bdb050bf72cfea9f: done: 0.009613 sec","job_status":"done","queue_duration_s":1.789875,"scheduling_latency_s":1.789888,"redis_calls":13,"redis_duration_s":0.0014650000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009613,"completed_at":"2026-08-20T05:55:21.464Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 145.961419] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a328250d839a1e5078d5cba","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a328250d839a1e5078d5cba: start","job_status":"start","queue_duration_s":1.800468,"scheduling_latency_s":1.800481}1409gitlab # [ 145.962072] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.475Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a328250d839a1e5078d5cba","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a328250d839a1e5078d5cba: done: 0.009631 sec","job_status":"done","queue_duration_s":1.800468,"scheduling_latency_s":1.800481,"redis_calls":13,"redis_duration_s":0.0014719999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009631,"completed_at":"2026-08-20T05:55:21.475Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 146.008833] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc5fe5fd76a0cb3f82b010da","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc5fe5fd76a0cb3f82b010da: start","job_status":"start","queue_duration_s":1.811052,"scheduling_latency_s":1.811066}1411gitlab # [ 146.009649] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc5fe5fd76a0cb3f82b010da","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc5fe5fd76a0cb3f82b010da: done: 0.009819 sec","job_status":"done","queue_duration_s":1.811052,"scheduling_latency_s":1.811066,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009819,"completed_at":"2026-08-20T05:55:21.485Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 146.019993] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.486Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"652ee86378f5a24e27af7246","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-652ee86378f5a24e27af7246: start","job_status":"start","queue_duration_s":1.821841,"scheduling_latency_s":1.821855}1413gitlab # [ 146.030125] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"652ee86378f5a24e27af7246","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-652ee86378f5a24e27af7246: done: 0.009689 sec","job_status":"done","queue_duration_s":1.821841,"scheduling_latency_s":1.821855,"redis_calls":13,"redis_duration_s":0.001454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009689,"completed_at":"2026-08-20T05:55:21.496Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 146.071086] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.497Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6781702f5da4354d2f8baf4c","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6781702f5da4354d2f8baf4c: start","job_status":"start","queue_duration_s":1.832516,"scheduling_latency_s":1.83253}1415gitlab # [ 146.071772] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6781702f5da4354d2f8baf4c","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6781702f5da4354d2f8baf4c: done: 0.01035 sec","job_status":"done","queue_duration_s":1.832516,"scheduling_latency_s":1.83253,"redis_calls":13,"redis_duration_s":0.002227,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001521,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01035,"completed_at":"2026-08-20T05:55:21.507Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 146.108099] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf6632ddf4a634bbddacb427","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf6632ddf4a634bbddacb427: start","job_status":"start","queue_duration_s":1.843846,"scheduling_latency_s":1.84386}1417gitlab # [ 146.145950] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.518Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf6632ddf4a634bbddacb427","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf6632ddf4a634bbddacb427: done: 0.0097 sec","job_status":"done","queue_duration_s":1.843846,"scheduling_latency_s":1.84386,"redis_calls":13,"redis_duration_s":0.0014629999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0097,"completed_at":"2026-08-20T05:55:21.518Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 146.146901] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"842e1fca8910215fdcbbb227","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-842e1fca8910215fdcbbb227: start","job_status":"start","queue_duration_s":1.85464,"scheduling_latency_s":1.854654}1419gitlab # [ 146.153852] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"842e1fca8910215fdcbbb227","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-842e1fca8910215fdcbbb227: done: 0.009657 sec","job_status":"done","queue_duration_s":1.85464,"scheduling_latency_s":1.854654,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009657,"completed_at":"2026-08-20T05:55:21.529Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 146.194913] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afe1c02591b3b5893bf9d18a","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afe1c02591b3b5893bf9d18a: start","job_status":"start","queue_duration_s":1.865129,"scheduling_latency_s":1.865144}1421gitlab # [ 146.195601] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afe1c02591b3b5893bf9d18a","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afe1c02591b3b5893bf9d18a: done: 0.009712 sec","job_status":"done","queue_duration_s":1.865129,"scheduling_latency_s":1.865144,"redis_calls":13,"redis_duration_s":0.0016259999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001161,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009712,"completed_at":"2026-08-20T05:55:21.539Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 146.253804] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.540Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80086076b7a5984af81a341b","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80086076b7a5984af81a341b: start","job_status":"start","queue_duration_s":1.875665,"scheduling_latency_s":1.875678}1423gitlab # [ 146.254648] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80086076b7a5984af81a341b","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80086076b7a5984af81a341b: done: 0.00975 sec","job_status":"done","queue_duration_s":1.875665,"scheduling_latency_s":1.875678,"redis_calls":13,"redis_duration_s":0.001508,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00975,"completed_at":"2026-08-20T05:55:21.550Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 146.288941] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b657076fcc40d41a3d1d75a","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b657076fcc40d41a3d1d75a: start","job_status":"start","queue_duration_s":1.886409,"scheduling_latency_s":1.886454}1425gitlab # [ 146.289601] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b657076fcc40d41a3d1d75a","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b657076fcc40d41a3d1d75a: done: 0.009791 sec","job_status":"done","queue_duration_s":1.886409,"scheduling_latency_s":1.886454,"redis_calls":13,"redis_duration_s":0.001462,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000471,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009791,"completed_at":"2026-08-20T05:55:21.561Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 146.325104] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23c48caee1003021a94e60ee","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23c48caee1003021a94e60ee: start","job_status":"start","queue_duration_s":1.897012,"scheduling_latency_s":1.897026}1427gitlab # [ 146.325892] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23c48caee1003021a94e60ee","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23c48caee1003021a94e60ee: done: 0.009546 sec","job_status":"done","queue_duration_s":1.897012,"scheduling_latency_s":1.897026,"redis_calls":13,"redis_duration_s":0.0014629999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009546,"completed_at":"2026-08-20T05:55:21.571Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 146.365214] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f996695be1fc7a3102a92834","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f996695be1fc7a3102a92834: start","job_status":"start","queue_duration_s":1.907519,"scheduling_latency_s":1.907533}1429gitlab # [ 146.365855] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f996695be1fc7a3102a92834","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f996695be1fc7a3102a92834: done: 0.009594 sec","job_status":"done","queue_duration_s":1.907519,"scheduling_latency_s":1.907533,"redis_calls":13,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000473,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009594,"completed_at":"2026-08-20T05:55:21.582Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 146.404274] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"667f1fce93c830dad17cc728","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-667f1fce93c830dad17cc728: start","job_status":"start","queue_duration_s":1.91808,"scheduling_latency_s":1.918093}1431gitlab # [ 146.406839] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"667f1fce93c830dad17cc728","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-667f1fce93c830dad17cc728: done: 0.010163 sec","job_status":"done","queue_duration_s":1.91808,"scheduling_latency_s":1.918093,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010163,"completed_at":"2026-08-20T05:55:21.593Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 146.449176] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb4b9e51ab7e341de29f740f","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb4b9e51ab7e341de29f740f: start","job_status":"start","queue_duration_s":1.929237,"scheduling_latency_s":1.929251}1433gitlab # [ 146.451678] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb4b9e51ab7e341de29f740f","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb4b9e51ab7e341de29f740f: done: 0.009652 sec","job_status":"done","queue_duration_s":1.929237,"scheduling_latency_s":1.929251,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009652,"completed_at":"2026-08-20T05:55:21.603Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 146.516923] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a771fea6b6361e4a03e8c50","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a771fea6b6361e4a03e8c50: start","job_status":"start","queue_duration_s":1.939878,"scheduling_latency_s":1.939892}1435gitlab # [ 146.517672] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.614Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a771fea6b6361e4a03e8c50","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a771fea6b6361e4a03e8c50: done: 0.009542 sec","job_status":"done","queue_duration_s":1.939878,"scheduling_latency_s":1.939892,"redis_calls":13,"redis_duration_s":0.001638,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001151,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009542,"completed_at":"2026-08-20T05:55:21.614Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 146.563628] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c230a2e4464c0b0ff2dfffc6","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c230a2e4464c0b0ff2dfffc6: start","job_status":"start","queue_duration_s":1.950417,"scheduling_latency_s":1.950464}1437gitlab # [ 146.564506] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c230a2e4464c0b0ff2dfffc6","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c230a2e4464c0b0ff2dfffc6: done: 0.009938 sec","job_status":"done","queue_duration_s":1.950417,"scheduling_latency_s":1.950464,"redis_calls":13,"redis_duration_s":0.001454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009938,"completed_at":"2026-08-20T05:55:21.625Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 146.576791] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b011c6c1045461570f36d07","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b011c6c1045461570f36d07: start","job_status":"start","queue_duration_s":1.961185,"scheduling_latency_s":1.961199}1439gitlab # [ 146.618965] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b011c6c1045461570f36d07","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b011c6c1045461570f36d07: done: 0.009683 sec","job_status":"done","queue_duration_s":1.961185,"scheduling_latency_s":1.961199,"redis_calls":13,"redis_duration_s":0.00146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009683,"completed_at":"2026-08-20T05:55:21.635Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 146.621717] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd1cd141be29adc21ba3cd57","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd1cd141be29adc21ba3cd57: start","job_status":"start","queue_duration_s":1.971684,"scheduling_latency_s":1.971697}1441gitlab # [ 146.632773] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd1cd141be29adc21ba3cd57","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd1cd141be29adc21ba3cd57: done: 0.009678 sec","job_status":"done","queue_duration_s":1.971684,"scheduling_latency_s":1.971697,"redis_calls":13,"redis_duration_s":0.001618,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001146,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009678,"completed_at":"2026-08-20T05:55:21.646Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 146.693946] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4b1e5bad613d3c49c371fb2","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4b1e5bad613d3c49c371fb2: start","job_status":"start","queue_duration_s":1.982185,"scheduling_latency_s":1.982198}1443gitlab # [ 146.694698] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4b1e5bad613d3c49c371fb2","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4b1e5bad613d3c49c371fb2: done: 0.009955 sec","job_status":"done","queue_duration_s":1.982185,"scheduling_latency_s":1.982198,"redis_calls":13,"redis_duration_s":0.001769,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001295,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009955,"completed_at":"2026-08-20T05:55:21.657Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 146.737971] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"332eb6bbf1b59b42854f0577","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-332eb6bbf1b59b42854f0577: start","job_status":"start","queue_duration_s":1.993116,"scheduling_latency_s":1.993131}1445gitlab # [ 146.738717] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"332eb6bbf1b59b42854f0577","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-332eb6bbf1b59b42854f0577: done: 0.009747 sec","job_status":"done","queue_duration_s":1.993116,"scheduling_latency_s":1.993131,"redis_calls":13,"redis_duration_s":0.0016150000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009747,"completed_at":"2026-08-20T05:55:21.667Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 146.758242] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e791a5c168b2f3e43331ac3","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e791a5c168b2f3e43331ac3: start","job_status":"start","queue_duration_s":2.003728,"scheduling_latency_s":2.003742}1447gitlab # [ 146.803811] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e791a5c168b2f3e43331ac3","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e791a5c168b2f3e43331ac3: done: 0.010304 sec","job_status":"done","queue_duration_s":2.003728,"scheduling_latency_s":2.003742,"redis_calls":13,"redis_duration_s":0.001764,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001232,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010304,"completed_at":"2026-08-20T05:55:21.678Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 146.804969] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c66e7012c24755420c23a88b","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c66e7012c24755420c23a88b: start","job_status":"start","queue_duration_s":2.014893,"scheduling_latency_s":2.014907}1449gitlab # [ 146.814531] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c66e7012c24755420c23a88b","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c66e7012c24755420c23a88b: done: 0.009802 sec","job_status":"done","queue_duration_s":2.014893,"scheduling_latency_s":2.014907,"redis_calls":13,"redis_duration_s":0.00164,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001044,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009802,"completed_at":"2026-08-20T05:55:21.689Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 146.883926] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7bef2a9c368ffa62ea7ccce","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7bef2a9c368ffa62ea7ccce: start","job_status":"start","queue_duration_s":2.025777,"scheduling_latency_s":2.02579}1451gitlab # [ 146.884731] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7bef2a9c368ffa62ea7ccce","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7bef2a9c368ffa62ea7ccce: done: 0.009933 sec","job_status":"done","queue_duration_s":2.025777,"scheduling_latency_s":2.02579,"redis_calls":13,"redis_duration_s":0.001518,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009933,"completed_at":"2026-08-20T05:55:21.700Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 146.894672] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea0ba6234b3bb1530e9afb52","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea0ba6234b3bb1530e9afb52: start","job_status":"start","queue_duration_s":2.036735,"scheduling_latency_s":2.036749}1453gitlab # [ 146.905718] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea0ba6234b3bb1530e9afb52","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea0ba6234b3bb1530e9afb52: done: 0.009595 sec","job_status":"done","queue_duration_s":2.036735,"scheduling_latency_s":2.036749,"redis_calls":13,"redis_duration_s":0.001477,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000477,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009595,"completed_at":"2026-08-20T05:55:21.711Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 146.964492] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6a7f060740e8a7a70ba3294","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6a7f060740e8a7a70ba3294: start","job_status":"start","queue_duration_s":2.047309,"scheduling_latency_s":2.047323}1455gitlab # [ 146.965134] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6a7f060740e8a7a70ba3294","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6a7f060740e8a7a70ba3294: done: 0.009621 sec","job_status":"done","queue_duration_s":2.047309,"scheduling_latency_s":2.047323,"redis_calls":13,"redis_duration_s":0.0014889999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009621,"completed_at":"2026-08-20T05:55:21.721Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 147.009732] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9f5bdae8dedfadf44e4407d","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9f5bdae8dedfadf44e4407d: start","job_status":"start","queue_duration_s":2.057895,"scheduling_latency_s":2.057908}1457gitlab # [ 147.010633] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9f5bdae8dedfadf44e4407d","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9f5bdae8dedfadf44e4407d: done: 0.009815 sec","job_status":"done","queue_duration_s":2.057895,"scheduling_latency_s":2.057908,"redis_calls":13,"redis_duration_s":0.001435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009815,"completed_at":"2026-08-20T05:55:21.732Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 147.055852] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35c47ac7b39b9cc1a0df254e","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35c47ac7b39b9cc1a0df254e: start","job_status":"start","queue_duration_s":2.068722,"scheduling_latency_s":2.068736}1459gitlab # [ 147.056630] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35c47ac7b39b9cc1a0df254e","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35c47ac7b39b9cc1a0df254e: done: 0.009577 sec","job_status":"done","queue_duration_s":2.068722,"scheduling_latency_s":2.068736,"redis_calls":13,"redis_duration_s":0.001485,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009577,"completed_at":"2026-08-20T05:55:21.743Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 147.106698] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9884efcdd8db24f47dedf7fb","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9884efcdd8db24f47dedf7fb: start","job_status":"start","queue_duration_s":2.079241,"scheduling_latency_s":2.079255}1461gitlab # [ 147.107568] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9884efcdd8db24f47dedf7fb","created_at":"2026-08-20T05:55:19.435Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-c021bfe20bfe4bb4","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"06becd9c17fdd518798990c8ae31b03b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.664Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9884efcdd8db24f47dedf7fb: done: 0.009779 sec","job_status":"done","queue_duration_s":2.079241,"scheduling_latency_s":2.079255,"redis_calls":13,"redis_duration_s":0.0015379999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009779,"completed_at":"2026-08-20T05:55:21.753Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 147.120741] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.754Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4c8e87711cbd3a34ec11aaef","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4c8e87711cbd3a34ec11aaef: start","job_status":"start","queue_duration_s":1.965552,"scheduling_latency_s":1.965567}1463gitlab # [ 147.132708] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4c8e87711cbd3a34ec11aaef","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4c8e87711cbd3a34ec11aaef: done: 0.026836 sec","job_status":"done","queue_duration_s":1.965552,"scheduling_latency_s":1.965567,"redis_calls":16,"redis_duration_s":0.002236,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000289,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001337,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000400609,"duration_s":0.026836,"completed_at":"2026-08-20T05:55:21.781Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006114,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 147.201036] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c654839dd4f2d9ab16e57d27","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c654839dd4f2d9ab16e57d27: start","job_status":"start","queue_duration_s":1.993442,"scheduling_latency_s":1.993456}1465gitlab # [ 147.201785] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c654839dd4f2d9ab16e57d27","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c654839dd4f2d9ab16e57d27: done: 0.010749 sec","job_status":"done","queue_duration_s":1.993442,"scheduling_latency_s":1.993456,"redis_calls":13,"redis_duration_s":0.001695,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010749,"completed_at":"2026-08-20T05:55:21.793Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000547,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 147.215720] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"127b5288f7b8eab42079beb1","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-127b5288f7b8eab42079beb1: start","job_status":"start","queue_duration_s":2.004992,"scheduling_latency_s":2.005006}1467gitlab # [ 147.227642] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"127b5288f7b8eab42079beb1","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-127b5288f7b8eab42079beb1: done: 0.010323 sec","job_status":"done","queue_duration_s":2.004992,"scheduling_latency_s":2.005006,"redis_calls":13,"redis_duration_s":0.001543,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010323,"completed_at":"2026-08-20T05:55:21.804Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000562,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 147.284248] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b7477230b61e98af1d15d4e1","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b7477230b61e98af1d15d4e1: start","job_status":"start","queue_duration_s":2.016324,"scheduling_latency_s":2.016338}1469gitlab # [ 147.284946] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b7477230b61e98af1d15d4e1","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b7477230b61e98af1d15d4e1: done: 0.010162 sec","job_status":"done","queue_duration_s":2.016324,"scheduling_latency_s":2.016338,"redis_calls":13,"redis_duration_s":0.0014889999999999999,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010162,"completed_at":"2026-08-20T05:55:21.815Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 147.309181] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"cd81e6cc730d787cbd296e4b","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-cd81e6cc730d787cbd296e4b: start","job_status":"start","queue_duration_s":2.027476,"scheduling_latency_s":2.02749}1471gitlab # [ 147.321029] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"cd81e6cc730d787cbd296e4b","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-cd81e6cc730d787cbd296e4b: done: 0.010257 sec","job_status":"done","queue_duration_s":2.027476,"scheduling_latency_s":2.02749,"redis_calls":13,"redis_duration_s":0.0014910000000000001,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000473,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010257,"completed_at":"2026-08-20T05:55:21.827Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000512,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 147.365291] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"9d928a0c84817ae1624ce2b6","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-9d928a0c84817ae1624ce2b6: start","job_status":"start","queue_duration_s":2.038997,"scheduling_latency_s":2.039011}1473gitlab # [ 147.367200] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"9d928a0c84817ae1624ce2b6","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-9d928a0c84817ae1624ce2b6: done: 0.013334 sec","job_status":"done","queue_duration_s":2.038997,"scheduling_latency_s":2.039011,"redis_calls":13,"redis_duration_s":0.002544,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001829,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013334,"completed_at":"2026-08-20T05:55:21.841Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000524,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 147.438049] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8f9cda3f3ed6baede41d0376","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8f9cda3f3ed6baede41d0376: start","job_status":"start","queue_duration_s":2.053746,"scheduling_latency_s":2.053771}1475gitlab # [ 147.438816] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8f9cda3f3ed6baede41d0376","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8f9cda3f3ed6baede41d0376: done: 0.017992 sec","job_status":"done","queue_duration_s":2.053746,"scheduling_latency_s":2.053771,"redis_calls":13,"redis_duration_s":0.002169,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000679,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00149,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017992,"completed_at":"2026-08-20T05:55:21.860Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00047,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 147.448582] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"0082e19e63a5d7695c874a83","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-0082e19e63a5d7695c874a83: start","job_status":"start","queue_duration_s":2.073452,"scheduling_latency_s":2.073478}1477gitlab # [ 147.460733] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"0082e19e63a5d7695c874a83","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-0082e19e63a5d7695c874a83: done: 0.014771 sec","job_status":"done","queue_duration_s":2.073452,"scheduling_latency_s":2.073478,"redis_calls":13,"redis_duration_s":0.0017829999999999999,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001225,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014771,"completed_at":"2026-08-20T05:55:21.877Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000444,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 147.510951] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"06c963d75460adab887b8ed3","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-06c963d75460adab887b8ed3: start","job_status":"start","queue_duration_s":2.089018,"scheduling_latency_s":2.089031}1479gitlab # [ 147.511690] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"06c963d75460adab887b8ed3","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-06c963d75460adab887b8ed3: done: 0.010465 sec","job_status":"done","queue_duration_s":2.089018,"scheduling_latency_s":2.089031,"redis_calls":13,"redis_duration_s":0.001715,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001221,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010465,"completed_at":"2026-08-20T05:55:21.888Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000358,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 147.566971] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"6289716977969f66bd2251a6","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-6289716977969f66bd2251a6: start","job_status":"start","queue_duration_s":2.100333,"scheduling_latency_s":2.100346}1481gitlab # [ 147.567571] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:55:21.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"6289716977969f66bd2251a6","created_at":"2026-08-20T05:55:19.763Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-7e661355eaf243d8","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"7a4248d5bbf06b3023a7f3bcfaab7e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:55:19.789Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-6289716977969f66bd2251a6: done: 0.010069 sec","job_status":"done","queue_duration_s":2.100333,"scheduling_latency_s":2.100346,"redis_calls":13,"redis_duration_s":0.001533,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010069,"completed_at":"2026-08-20T05:55:21.899Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000354,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 147.762523] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1336878003 wd_nsec: 13368778741483gitlab # [ 164.289086] setup-gitlab-start[2225]: W, [2026-08-20T05:55:40.354646 #2225] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1484gitlab # [ 185.394747] postgres[2438]: [2438] ERROR: relation "table_without_models" does not exist1485gitlab # [ 185.395457] postgres[2438]: [2438] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1486gitlab # [ 188.006320] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:04.071Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"f5490a4200bbfd949e6878c6","created_at":"2026-08-20T05:56:04.026Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5893d6c56903ca38319fced33eedb241","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.069Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-f5490a4200bbfd949e6878c6: start","job_status":"start","queue_duration_s":0.001859,"scheduling_latency_s":0.001889}1487gitlab # [ 188.142943] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:04.208Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"f5490a4200bbfd949e6878c6","created_at":"2026-08-20T05:56:04.026Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5893d6c56903ca38319fced33eedb241","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.069Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-f5490a4200bbfd949e6878c6: done: 0.137507 sec","job_status":"done","queue_duration_s":0.001859,"scheduling_latency_s":0.001889,"redis_calls":16,"redis_duration_s":0.031135,"redis_read_bytes":17,"redis_write_bytes":4265,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000985,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":235,"redis_queues_calls":2,"redis_queues_duration_s":0.000703,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.022415,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.007032,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.137507,"completed_at":"2026-08-20T05:56:04.208Z","load_balancing_strategy":"primary","db_duration_s":0.015011,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 188.182203] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:04.248Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"9d568dc35af1ea06e251c4ab","created_at":"2026-08-20T05:56:04.120Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37f1374152633ab65ebe66e401e23f9a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.134Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-9d568dc35af1ea06e251c4ab: start","job_status":"start","queue_duration_s":0.113446,"scheduling_latency_s":0.113471}1489gitlab # [ 188.287487] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:04.352Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"9d568dc35af1ea06e251c4ab","created_at":"2026-08-20T05:56:04.120Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37f1374152633ab65ebe66e401e23f9a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.134Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-9d568dc35af1ea06e251c4ab: done: 0.104845 sec","job_status":"done","queue_duration_s":0.113446,"scheduling_latency_s":0.113471,"redis_calls":12,"redis_duration_s":0.032264,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002003,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.022079,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008182,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001061587,"exclusive_lock_hold_duration_s":0.015466212,"duration_s":0.104845,"completed_at":"2026-08-20T05:56:04.352Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034171,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 188.295944] runuser[2224]: pam_unix(runuser:session): session closed for user gitlab1491gitlab # [ 188.297305] setup-gitlab-start[2206]: + systemctl restart gitlab-sidekiq.service1492gitlab # [ 188.320989] systemd[1]: Stopping gitlab-sidekiq.service...1493gitlab # [ 188.327088] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:04.393Z","message":"Shutting down"}1494gitlab # [ 188.328588] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:04.393Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b6a1575455fb4c0d613c4f14","created_at":"2026-08-20T05:56:04.144Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22d1772c166e71b33c626c491d60f8fa","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.146Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b6a1575455fb4c0d613c4f14: start","job_status":"start","queue_duration_s":0.247513,"scheduling_latency_s":0.247562}1495gitlab # [ 188.402385] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:04.467Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b6a1575455fb4c0d613c4f14","created_at":"2026-08-20T05:56:04.144Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22d1772c166e71b33c626c491d60f8fa","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.146Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b6a1575455fb4c0d613c4f14: done: 0.074089 sec","job_status":"done","queue_duration_s":0.247513,"scheduling_latency_s":0.247562,"redis_calls":9,"redis_duration_s":0.01537,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00549,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00988,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001236749,"exclusive_lock_hold_duration_s":0.004791949,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.074089,"completed_at":"2026-08-20T05:56:04.467Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001841,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 188.440244] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:04.506Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"2ae46765f29aa11dfee9b61f","created_at":"2026-08-20T05:56:04.152Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad6b282d6810a1affe98fef17f931337","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.154Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-2ae46765f29aa11dfee9b61f: start","job_status":"start","queue_duration_s":0.351279,"scheduling_latency_s":0.351313}1497gitlab # [ 188.497066] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:04.562Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"2ae46765f29aa11dfee9b61f","created_at":"2026-08-20T05:56:04.152Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad6b282d6810a1affe98fef17f931337","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.154Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-2ae46765f29aa11dfee9b61f: done: 0.056693 sec","job_status":"done","queue_duration_s":0.351279,"scheduling_latency_s":0.351313,"redis_calls":10,"redis_duration_s":0.017936,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012327,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005609,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.008572877,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.056693,"completed_at":"2026-08-20T05:56:04.562Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00369,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1498gitlab # [ 188.535117] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:04.601Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"28f4700410669c2e651a34c0","created_at":"2026-08-20T05:56:04.158Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79557f76bb75cb8f8be930de283917cb","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.163Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-28f4700410669c2e651a34c0: start","job_status":"start","queue_duration_s":0.437386,"scheduling_latency_s":0.43741}1499gitlab # [ 188.645924] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:04.710Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"28f4700410669c2e651a34c0","created_at":"2026-08-20T05:56:04.158Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79557f76bb75cb8f8be930de283917cb","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.163Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-28f4700410669c2e651a34c0: done: 0.109177 sec","job_status":"done","queue_duration_s":0.437386,"scheduling_latency_s":0.43741,"redis_calls":10,"redis_duration_s":0.038940999999999996,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002984,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.034343,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001614,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000957943,"duration_s":0.109177,"completed_at":"2026-08-20T05:56:04.710Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012043,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 188.651106] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:04.717Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"06d4198791cefd08be12c132","created_at":"2026-08-20T05:56:04.171Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71657aa003984453","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5893d6c56903ca38319fced33eedb241","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.182Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-06d4198791cefd08be12c132: start","job_status":"start","queue_duration_s":0.534065,"scheduling_latency_s":0.534104}1501gitlab # [ 188.731772] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:04.797Z","message":"No existing merge request to be cleaned up."}1502gitlab # [ 188.755949] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:04.822Z","message":"Scheduler exiting..."}1503gitlab # [ 188.757754] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:04.823Z","message":"Terminating quiet threads for default capsule"}1504gitlab # [ 188.758314] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:04.824Z","message":"Scheduler exiting..."}1505gitlab # [ 188.761828] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:04.827Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"06d4198791cefd08be12c132","created_at":"2026-08-20T05:56:04.171Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71657aa003984453","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5893d6c56903ca38319fced33eedb241","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.182Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"mae7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-06d4198791cefd08be12c132: done: 0.110416 sec","job_status":"done","queue_duration_s":0.534065,"scheduling_latency_s":0.534104,"redis_calls":10,"redis_duration_s":0.019818,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.012374,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.007444,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.110416,"completed_at":"2026-08-20T05:56:04.827Z","load_balancing_strategy":"primary","db_duration_s":0.007317,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 189.262136] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:05.327Z","message":"Bye!"}1507gitlab # [ 189.278660] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-08-20T05:56:05.344Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1611,"worker_id":"sidekiq_0","memwd_rss_bytes":966447104,"retry":0}1508gitlab # [ 190.806326] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1509gitlab # [ 190.807401] systemd[1]: Stopped gitlab-sidekiq.service.1510gitlab # [ 190.808159] systemd[1]: gitlab-sidekiq.service: Consumed 57.372s CPU time over 1min 58.112s wall clock time, 983.6M memory peak, 5.4M read from disk.1511gitlab # [ 190.815352] systemd[1]: Started gitlab-sidekiq.service.1512gitlab # [ 190.816851] setup-gitlab-start[2206]: + mkdir -p /var/lib/secrets1513gitlab # [ 190.819588] setup-gitlab-start[2206]: + echo nixbot-test-token-of-20-chars1514gitlab # [ 190.820215] setup-gitlab-start[2206]: + chmod 644 /var/lib/secrets/gitlab-token1515gitlab # [ 190.822366] setup-gitlab-start[2206]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1516gitlab # [ 191.666610] gitaly[898]: time="2026-08-20T05:56:07.732Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:17.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:07.731" pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1517gitlab # [ 191.666930] gitaly[898]: time="2026-08-20T05:56:07.732Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:17.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:07.731" grpc.time_ms=0.582 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1518gitlab # [ 191.845923] gitaly[898]: time="2026-08-20T05:56:07.912Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:17.191" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:07.912" pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1519gitlab # [ 191.846291] gitaly[898]: time="2026-08-20T05:56:07.912Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:17.191" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:07.912" grpc.time_ms=0.222 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1520gitlab # [ 191.910516] gitaly[898]: time="2026-08-20T05:56:07.976Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 diskcache=abf52956-f9f5-436b-bf12-cf520f3ca2ff grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:56:17.214" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:07.935" pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1521gitlab # [ 191.919266] gitaly[898]: time="2026-08-20T05:56:07.977Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1575 command.oublock=32 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:56:17.214" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:07.935" grpc.time_ms=41.706 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1522gitlab # [ 191.930433] gitaly[898]: time="2026-08-20T05:56:07.988Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:17.267" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:07.987" pid=898 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1523gitlab # [ 191.939163] gitaly[898]: time="2026-08-20T05:56:07.988Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:17.267" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:07.987" grpc.time_ms=0.406 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1524gitlab # [ 191.948106] gitaly[898]: time="2026-08-20T05:56:08.000Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:56:17.270" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:07.991" grpc.time_ms=9.165 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1525gitlab # [ 191.994610] gitaly[898]: time="2026-08-20T05:56:08.060Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:18.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:08.060" pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1526gitlab # [ 192.003678] gitaly[898]: time="2026-08-20T05:56:08.061Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:18.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:08.060" grpc.time_ms=0.267 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1527gitlab # [ 192.034927] gitaly[898]: time="2026-08-20T05:56:08.101Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 diskcache=47e4156a-7b4d-41d0-b978-0f664fcee209 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:56:18.012" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:08.063" pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1528gitlab # [ 192.044625] gitaly[898]: time="2026-08-20T05:56:08.101Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1583 command.oublock=32 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:56:18.012" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:08.063" grpc.time_ms=38.186 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1529gitlab # [ 192.044940] gitaly[898]: time="2026-08-20T05:56:08.108Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:18.056" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:08.107" pid=898 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1530gitlab # [ 192.045583] gitaly[898]: time="2026-08-20T05:56:08.108Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:18.056" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:08.107" grpc.time_ms=0.749 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1531gitlab # [ 192.079660] gitaly[898]: time="2026-08-20T05:56:08.145Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=33 command.spawn_token_fork_ms=28 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:56:18.060" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:08.111" grpc.time_ms=34.444 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1532gitlab # [ 192.129356] gitaly[898]: time="2026-08-20T05:56:08.195Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:18.144" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:08.195" grpc.time_ms=0.138 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1533gitlab # [ 192.147105] gitaly[898]: time="2026-08-20T05:56:08.213Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:56:18.162" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:08.212" grpc.time_ms=0.335 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1534gitlab # [ 192.616501] gitaly[898]: time="2026-08-20T05:56:08.682Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVD45VT3FKV47TZ4ZRV27 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:56:18.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:08.675" grpc.time_ms=6.76 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1535gitlab # [ 193.022028] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:09 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 21691536gitlab # [ 193.026430] setup-gitlab-start[2206]: + mkdir -p /tmp/test-flake1537gitlab # [ 193.029115] setup-gitlab-start[2206]: + cd /tmp/test-flake1538gitlab # [ 193.029526] setup-gitlab-start[2206]: + git init -b master1539gitlab # [ 193.054817] setup-gitlab-start[2522]: Initialized empty Git repository in /tmp/test-flake/.git/1540gitlab # [ 193.055976] setup-gitlab-start[2206]: + git config user.name test1541gitlab # [ 193.060604] setup-gitlab-start[2206]: + git config user.email test@example.com1542gitlab # [ 193.064428] setup-gitlab-start[2206]: + cat1543gitlab # [ 193.068238] setup-gitlab-start[2206]: + git add flake.nix1544gitlab # [ 193.071360] setup-gitlab-start[2206]: + git commit -m 'initial commit'1545gitlab # [ 193.082512] setup-gitlab-start[2527]: [master (root-commit) 887f27e] initial commit1546gitlab # [ 193.083584] setup-gitlab-start[2527]: 1 file changed, 10 insertions(+)1547gitlab # [ 193.084463] setup-gitlab-start[2527]: create mode 100644 flake.nix1548gitlab # [ 193.085670] setup-gitlab-start[2206]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1549gitlab # [ 193.092772] setup-gitlab-start[2206]: + git push -u origin master1550gitlab # [ 193.225784] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:09 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 1051551gitlab # [ 193.336228] gitaly[898]: time="2026-08-20T05:56:09.402Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFED4VGPMBBMFV070SFZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:09.395" grpc.time_ms=6.405 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1552gitlab # [ 193.348636] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:09 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1101553gitlab # [ 193.581694] gitaly[898]: time="2026-08-20T05:56:09.647Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:56:19.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:09.641" grpc.time_ms=6.51 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1554gitlab # [ 193.645380] gitaly[898]: time="2026-08-20T05:56:09.711Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T05:56:39.002" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T05:56:09.702" grpc.time_ms=8.365 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1555gitlab # [ 193.673324] gitaly[898]: time="2026-08-20T05:56:09.728Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 duration_ms=158ns method=POST pid=898 status=200 url="http://unix/api/v4/internal/allowed"1556gitlab # [ 193.688454] gitaly[898]: time="2026-08-20T05:56:09.754Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 duration_ms=25ns method=POST pid=898 status=200 url="http://unix/api/v4/internal/pre_receive"1557gitlab # [ 193.693521] gitaly[898]: time="2026-08-20T05:56:09.759Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:09.568" grpc.time_ms=186.159 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1558gitlab # [ 193.747753] gitaly[898]: time="2026-08-20T05:56:09.813Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:09.812" grpc.time_ms=0.869 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1559gitlab # [ 193.784167] gitaly[898]: time="2026-08-20T05:56:09.849Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:09.848" grpc.time_ms=0.47 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1560gitlab # [ 193.815557] gitaly[898]: time="2026-08-20T05:56:09.881Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:09.881" grpc.time_ms=0.336 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1561gitlab # [ 193.903324] gitaly[898]: time="2026-08-20T05:56:09.969Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:56:19.239" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:09.959" grpc.time_ms=9.524 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1562gitlab # [ 193.929187] gitaly[898]: time="2026-08-20T05:56:09.995Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1564 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T05:56:19.257" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:09.977" grpc.time_ms=17.261 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1563gitlab # [ 193.949627] gitaly[898]: time="2026-08-20T05:56:10.015Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 duration_ms=101ns method=POST pid=898 status=200 url="http://unix/api/v4/internal/post_receive"1564gitlab # [ 193.952412] gitaly[898]: time="2026-08-20T05:56:10.016Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:09.913" grpc.time_ms=103 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1565gitlab # [ 193.953197] sidekiq-cluster[2470]: {"severity":"INFO","time":"2026-08-20T05:56:10.002Z","message":"Starting cluster with 1 processes"}1566gitlab # [ 193.969888] gitaly[898]: time="2026-08-20T05:56:10.036Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 diskcache=ee1b8aa2-5afa-4f70-aed2-69a02929ab34 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:09.492" pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1567gitlab # [ 193.970371] gitaly[898]: time="2026-08-20T05:56:10.036Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=215 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=14098 command.oublock=32 command.real_time_ms=535 command.spawn_token_fork_ms=0 command.system_time_ms=146 command.user_time_ms=69 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:09.492" grpc.time_ms=543.632 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1568gitlab # [ 193.988796] gitlab-workhorse[822]: time="2026-08-20T05:56:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521569gitlab # [ 193.989398] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:10 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6231570gitlab # [ 193.993672] setup-gitlab-start[2531]: To http://gitlab/root/test-flake.git1571gitlab # [ 193.993948] setup-gitlab-start[2531]: * [new branch] master -> master1572gitlab # [ 193.997907] setup-gitlab-start[2531]: branch 'master' set up to track 'origin/master'.1573gitlab # [ 194.001267] systemd[1]: Finished setup-gitlab.service.1574gitlab # [ 194.004058] systemd[1]: Starting nixbot CI service...1575gitlab: (finished: waiting for unit setup-gitlab.service, in 195.66 seconds)1576gitlab: waiting for unit nixbot.service1577gitlab # [ 195.091854] nixbot[2614]: {"ts": "2026-08-20T05:56:11.157Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1578gitlab # [ 195.120910] nixbot[2614]: {"ts": "2026-08-20T05:56:11.187Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1579gitlab # [ 195.148957] nixbot[2614]: {"ts": "2026-08-20T05:56:11.215Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1580gitlab # [ 195.155672] nixbot[2614]: {"ts": "2026-08-20T05:56:11.221Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1581gitlab # [ 195.160160] nixbot[2614]: {"ts": "2026-08-20T05:56:11.226Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1582gitlab # [ 195.169164] nixbot[2614]: {"ts": "2026-08-20T05:56:11.235Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1583gitlab # [ 195.174638] nixbot[2614]: {"ts": "2026-08-20T05:56:11.240Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1584gitlab # [ 195.178119] nixbot[2614]: {"ts": "2026-08-20T05:56:11.244Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1585gitlab # [ 195.185600] nixbot[2614]: {"ts": "2026-08-20T05:56:11.251Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1586gitlab # [ 195.189407] nixbot[2614]: {"ts": "2026-08-20T05:56:11.255Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1587gitlab # [ 195.196952] nixbot[2614]: {"ts": "2026-08-20T05:56:11.263Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1588gitlab # [ 195.205186] nixbot[2614]: {"ts": "2026-08-20T05:56:11.271Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1589gitlab # [ 195.211705] nixbot[2614]: {"ts": "2026-08-20T05:56:11.277Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1590gitlab # [ 195.216632] nixbot[2614]: {"ts": "2026-08-20T05:56:11.282Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1591gitlab # [ 195.222324] nixbot[2614]: {"ts": "2026-08-20T05:56:11.288Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1592gitlab # [ 195.226198] nixbot[2614]: {"ts": "2026-08-20T05:56:11.292Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1593gitlab # [ 195.229809] nixbot[2614]: {"ts": "2026-08-20T05:56:11.295Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1594gitlab # [ 195.233302] nixbot[2614]: {"ts": "2026-08-20T05:56:11.299Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1595gitlab # [ 195.241597] nixbot[2614]: {"ts": "2026-08-20T05:56:11.307Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1596gitlab # [ 195.244745] nixbot[2614]: {"ts": "2026-08-20T05:56:11.310Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1597gitlab # [ 195.250200] nixbot[2614]: {"ts": "2026-08-20T05:56:11.316Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1598gitlab # [ 195.257118] nixbot[2614]: {"ts": "2026-08-20T05:56:11.323Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1599gitlab # [ 195.260318] nixbot[2614]: {"ts": "2026-08-20T05:56:11.326Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1600gitlab # [ 195.263927] nixbot[2614]: {"ts": "2026-08-20T05:56:11.330Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1601gitlab # [ 195.267423] nixbot[2614]: {"ts": "2026-08-20T05:56:11.333Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1602gitlab # [ 195.560185] nixbot[2614]: INFO: Started server process [2614]1603gitlab # [ 195.562582] nixbot[2614]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1604gitlab # [ 195.597449] nixbot[2614]: INFO: ::ffff:127.0.0.1:36246 - "GET /health HTTP/1.1" 200 OK1605gitlab # [ 195.602568] systemd[1]: Started nixbot CI service.1606gitlab # [ 195.604361] systemd[1]: Reached target Multi-User System.1607gitlab # [ 195.604889] systemd[1]: Startup finished in 1.298s (kernel) + 3.680s (initrd) + 3min 10.625s (userspace) = 3min 15.604s.1608gitlab: (finished: waiting for unit nixbot.service, in 1.06 seconds)1609gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1610gitlab # [ 196.134622] nixbot[2614]: INFO: ::ffff:127.0.0.1:36262 - "GET /health HTTP/1.1" 200 OK1611gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1612subtest: project discovered and webhook registered1613gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1614gitlab # [ 196.236856] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 621615gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.10 seconds)1616gitlab # [ 196.346114] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:12 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 7481617gitlab # [ 196.348821] nixbot[2614]: {"ts": "2026-08-20T05:56:12.414Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1618gitlab # [ 196.370589] nixbot[2614]: {"ts": "2026-08-20T05:56:12.436Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1619gitlab # [ 196.456992] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 691620gitlab # [ 196.459196] nixbot[2614]: {"ts": "2026-08-20T05:56:12.525Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1621gitlab # [ 196.461356] nixbot[2614]: {"ts": "2026-08-20T05:56:12.527Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1622gitlab # [ 196.623837] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 1521623gitlab # [ 196.625580] nixbot[2614]: {"ts": "2026-08-20T05:56:12.691Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1624gitlab # [ 196.763097] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:12 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1271625gitlab # [ 196.768202] nixbot[2614]: {"ts": "2026-08-20T05:56:12.830Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1626gitlab # [ 196.879472] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 1031627gitlab # [ 196.884450] nixbot[2614]: {"ts": "2026-08-20T05:56:12.946Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1628gitlab # [ 196.960335] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:13 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 761629gitlab # [ 196.961829] nixbot[2614]: {"ts": "2026-08-20T05:56:13.027Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1630gitlab # [ 197.027177] gitaly[898]: time="2026-08-20T05:56:13.092Z" level=info msg="finished unary call with code OK" catfile.duration_ms=4 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=4 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVK3BV69XW6NVW1W9B8XH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-20T05:56:43.074" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:13.074" grpc.time_ms=17.281 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1631gitlab # [ 197.071811] gitaly[898]: time="2026-08-20T05:56:13.138Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVK3BV69XW6NVW1W9B8XH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:56:43.136" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:13.136" grpc.time_ms=0.96 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1632gitlab # [ 197.112071] gitaly[898]: time="2026-08-20T05:56:13.178Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVK3BV69XW6NVW1W9B8XH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-20T05:56:23.116" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:13.166" grpc.time_ms=11.328 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1633gitlab # [ 197.145494] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1751634gitlab # [ 197.149738] nixbot[2614]: {"ts": "2026-08-20T05:56:13.215Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1635gitlab # [ 197.221669] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 671636gitlab # [ 197.223584] nixbot[2614]: {"ts": "2026-08-20T05:56:13.289Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1637gitlab # [ 197.229467] nixbot[2614]: {"ts": "2026-08-20T05:56:13.295Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1638gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1639gitlab # [ 197.324992] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 581640gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.09 seconds)1641(finished: subtest: project discovered and webhook registered, in 1.19 seconds)1642subtest: push delivers the webhook1643gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1644gitlab # [ 197.335993] gitaly[898]: time="2026-08-20T05:56:13.401Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=10 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKCW7ASSVJDDH6S7BZNQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.382" grpc.time_ms=18.828 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc1645gitlab # [ 197.359946] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 851646gitlab # [ 197.420681] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:13 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 291647gitlab # [ 197.455567] gitaly[898]: time="2026-08-20T05:56:13.521Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVKFPAVE8DCM0TQA3VE87 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.508" pid=898 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1648gitlab # [ 197.474150] gitaly[898]: time="2026-08-20T05:56:13.521Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVKFPAVE8DCM0TQA3VE87 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.508" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc1649gitlab # [ 197.491357] gitaly[898]: time="2026-08-20T05:56:13.557Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVKFPAVE8DCM0TQA3VE87 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.508" grpc.time_ms=48.653 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc1650gitlab # [ 197.506064] gitlab-workhorse[822]: time="2026-08-20T05:56:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131651gitlab # [ 197.506337] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1411652gitlab # [ 197.563284] gitaly[898]: time="2026-08-20T05:56:13.629Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVKMAVS9D3DN66RPYE958 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.615" pid=898 remote_ip="2001:db8:1::1" request_sha=ed702f7f2a0a0627e526c3ee057e1c9d7d1f909f response_bytes=229 span.kind=server system=grpc1653gitlab # [ 197.579649] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:13 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 1531654gitlab # [ 197.580086] gitaly[898]: time="2026-08-20T05:56:13.629Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1198 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVKMAVS9D3DN66RPYE958 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.615" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc1655gitlab # [ 197.580645] gitaly[898]: time="2026-08-20T05:56:13.646Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1198 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVKMAVS9D3DN66RPYE958 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.615" grpc.time_ms=30.451 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc1656gitlab # [ 197.581461] gitaly[898]: time="2026-08-20T05:56:13.645Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKHK17CENCE45EYNH78K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.639" grpc.time_ms=5.926 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1657gitlab # [ 197.582349] gitlab-workhorse[822]: time="2026-08-20T05:56:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2291658gitlab # [ 197.583706] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 229 "" "git/2.55.0" 701659gitlab # Enumerating objects: 5, done.1660gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1661gitlab # Delta compression using up to 4 threads1662gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1663gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done.1664gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1665gitlab # [ 197.697670] gitaly[898]: time="2026-08-20T05:56:13.763Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKRT8VJ5RXG8KWV1W9Z8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.756" grpc.time_ms=7.259 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc1666gitlab # [ 197.698325] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 411667gitlab # [ 197.751927] gitaly[898]: time="2026-08-20T05:56:13.818Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVKT54WM246B17X6QJEHD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.808" pid=898 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1668gitlab # [ 197.752507] gitaly[898]: time="2026-08-20T05:56:13.818Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVKT54WM246B17X6QJEHD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.808" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc1669gitlab # [ 197.753501] gitaly[898]: time="2026-08-20T05:56:13.818Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVKT54WM246B17X6QJEHD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.808" grpc.time_ms=10.335 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc1670gitlab # [ 197.754083] gitlab-workhorse[822]: time="2026-08-20T05:56:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671671gitlab # [ 197.754742] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 531672gitlab # [ 197.834444] gitaly[898]: time="2026-08-20T05:56:13.900Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T05:56:43.894" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T05:56:13.894" grpc.time_ms=6.043 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1673gitlab # [ 197.850674] gitaly[898]: time="2026-08-20T05:56:13.916Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=9 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKXGHN7195D9HXP5S8T6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.903" grpc.time_ms=13.357 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc1674gitlab # [ 197.853538] gitaly[898]: time="2026-08-20T05:56:13.919Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EVVKR7NRPFCST1Z8666QEE duration_ms=106ns method=POST pid=898 status=200 url="http://unix/api/v4/internal/allowed"1675gitlab # [ 197.863816] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 571676gitlab # [ 197.894711] gitaly[898]: time="2026-08-20T05:56:13.960Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EVVKR7NRPFCST1Z8666QEE duration_ms=40ns method=POST pid=898 status=200 url="http://unix/api/v4/internal/pre_receive"1677gitlab # [ 197.895304] gitaly[898]: time="2026-08-20T05:56:13.961Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:13.812" grpc.time_ms=148.329 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1678gitlab # [ 197.913674] gitaly[898]: time="2026-08-20T05:56:13.979Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVKZB3S028R7WT877BHEE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.969" pid=898 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1679gitlab # [ 197.913856] gitaly[898]: time="2026-08-20T05:56:13.980Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1170 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVKZB3S028R7WT877BHEE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.969" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc1680gitlab # [ 197.914498] gitaly[898]: time="2026-08-20T05:56:13.980Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1170 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVKZB3S028R7WT877BHEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.969" grpc.time_ms=10.956 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc1681gitlab # [ 197.915181] gitlab-workhorse[822]: time="2026-08-20T05:56:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091682gitlab # [ 197.915706] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 491683gitlab # [ 197.951589] gitaly[898]: time="2026-08-20T05:56:14.017Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:14.017" grpc.time_ms=0.375 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1684gitlab # [ 197.980364] gitaly[898]: time="2026-08-20T05:56:14.046Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:14.046" grpc.time_ms=0.419 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1685gitlab # [ 198.008029] gitaly[898]: time="2026-08-20T05:56:14.074Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:14.072" grpc.time_ms=0.784 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1686gitlab # [ 198.034571] gitaly[898]: time="2026-08-20T05:56:14.100Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:56:44.099" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:14.099" grpc.time_ms=0.452 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1687gitlab # [ 198.056930] gitaly[898]: time="2026-08-20T05:56:14.123Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T05:56:44.115" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:14.116" grpc.time_ms=6.702 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1688gitlab # [ 198.073609] gitaly[898]: time="2026-08-20T05:56:14.139Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:56:24.082" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:14.132" grpc.time_ms=6.863 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1689gitlab # [ 198.090640] gitaly[898]: time="2026-08-20T05:56:14.156Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:56:24.101" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:14.151" grpc.time_ms=5.183 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1690gitlab # [ 198.116421] gitaly[898]: time="2026-08-20T05:56:14.182Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EVVKR7NRPFCST1Z8666QEE duration_ms=83ns method=POST pid=898 status=200 url="http://unix/api/v4/internal/post_receive"1691gitlab # [ 198.117772] gitaly[898]: time="2026-08-20T05:56:14.184Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:14.098" grpc.time_ms=85.513 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1692gitlab # [ 198.138525] gitaly[898]: time="2026-08-20T05:56:14.204Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE diskcache=6966cb9b-e5b5-48b0-b252-6893daa166ef grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.759" pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1693gitlab # To http://gitlab/root/test-flake.git1694gitlab # [ 198.146519] gitlab-workhorse[822]: time="2026-08-20T05:56:14Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521695gitlab # 887f27e..d3f019c [ 198.148377] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:14 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5021696gitlab # [ 198.148951] gitaly[898]: time="2026-08-20T05:56:14.204Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=119 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=876544 command.minflt=12988 command.oublock=32 command.real_time_ms=435 command.spawn_token_fork_ms=0 command.system_time_ms=77 command.user_time_ms=42 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:13.759" grpc.time_ms=445.447 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1697gitlab # [ 198.149562] gitaly[898]: time="2026-08-20T05:56:14.212Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:56:24.156" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:14.206" grpc.time_ms=0.178 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1698gitlab # [ 198.159470] gitaly[898]: time="2026-08-20T05:56:14.225Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:56:24.168" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:14.219" grpc.time_ms=6.566 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1699gitlab # master -> master1700gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.86 seconds)1701gitlab: must succeed: git -C /tmp/test-flake rev-parse master1702gitlab # [ 198.188412] gitaly[898]: time="2026-08-20T05:56:14.254Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:14.254" grpc.time_ms=0.511 pid=898 span.kind=server system=grpc1703gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1704gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1705gitlab # [ 198.215029] gitaly[898]: time="2026-08-20T05:56:14.281Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:14.281" grpc.time_ms=0.24 pid=898 span.kind=server system=grpc1706gitlab # [ 198.232076] gitaly[898]: time="2026-08-20T05:56:14.298Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 diskcache=48618a2d-9e96-428a-ba9f-e46a202878df grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:56:24.177" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:14.227" pid=898 ref=refs/keep-around/887f27e7d697883edeccf41f10639c0a5316948f remote_ip="2001:db8:1::1" revision=887f27e7d697883edeccf41f10639c0a5316948f span.kind=server system=grpc username=root1707gitlab # [ 198.232506] gitaly[898]: time="2026-08-20T05:56:14.298Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=32 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5343 command.oublock=8 command.real_time_ms=62 command.spawn_token_fork_ms=2 command.system_time_ms=21 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:56:24.177" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:14.227" grpc.time_ms=70.714 pid=898 ref=refs/keep-around/887f27e7d697883edeccf41f10639c0a5316948f remote_ip="2001:db8:1::1" revision=887f27e7d697883edeccf41f10639c0a5316948f span.kind=server system=grpc username=root1708gitlab # [ 198.239299] gitaly[898]: time="2026-08-20T05:56:14.305Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:56:44.304" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:14.305" grpc.time_ms=0.416 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1709gitlab # [ 198.265149] nixbot[2614]: INFO: ::ffff:127.0.0.1:36264 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1710gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.07 seconds)1711gitlab # [ 198.341930] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/887f27e7d697883edeccf41f10639c0a5316948f HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3491712gitlab # [ 198.346861] nixbot[2614]: {"ts": "2026-08-20T05:56:14.408Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/887f27e7d697883edeccf41f10639c0a5316948f \"HTTP/1.1 201 Created\""}1713gitlab # [ 198.351938] nixbot[2614]: {"ts": "2026-08-20T05:56:14.417Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-887f27e7d697-0"}1714gitlab # [ 198.403976] systemd[1]: Started Nix Daemon.1715gitlab # [ 198.456816] nix-daemon[2819]: accepted connection from pid 2813, user nixbot1716gitlab # [ 198.533602] nix-daemon[2819]: accepted connection from pid 2826, user nixbot1717gitlab # [ 198.550105] nixbot[2614]: {"ts": "2026-08-20T05:56:14.616Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-887f27e7d697-0", "argv0": "bwrap"}1718gitlab # [ 198.682250] nix-daemon[2819]: accepted connection from pid 2836, user nixbot1719gitlab # [ 198.727740] nix-daemon[2819]: accepted connection from pid 2846, user nixbot1720gitlab # [ 198.741743] nix-daemon[2819]: accepted connection from pid 2836, user nixbot1721gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1722gitlab # [ 199.304367] nixbot[2614]: INFO: ::ffff:127.0.0.1:36266 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1723gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1724gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1725gitlab # [ 200.342950] nixbot[2614]: INFO: ::ffff:127.0.0.1:36270 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1726gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1727gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1728gitlab # [ 201.380827] nixbot[2614]: INFO: ::ffff:127.0.0.1:36282 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1729gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1730gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1731gitlab # [ 202.419440] nixbot[2614]: INFO: ::ffff:127.0.0.1:36290 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1732gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1733gitlab # [ 203.293166] nix-daemon[2819]: accepted connection from pid 2874, user nixbot1734gitlab # [ 203.327604] gitaly[898]: time="2026-08-20T05:56:19.393Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVS8BGWA0AD5WH10QQP97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:56:49.391" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:19.392" grpc.time_ms=0.663 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1735gitlab # [ 203.359092] gitaly[898]: time="2026-08-20T05:56:19.425Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVS8BGWA0AD5WH10QQP97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:56:29.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:19.419" grpc.time_ms=6.201 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1736gitlab # [ 203.394617] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/887f27e7d697883edeccf41f10639c0a5316948f HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 1201737gitlab # [ 203.397434] nixbot[2614]: {"ts": "2026-08-20T05:56:19.463Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/887f27e7d697883edeccf41f10639c0a5316948f \"HTTP/1.1 201 Created\""}1738gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1739gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.02 seconds)1740gitlab # [ 203.448427] nixbot[2614]: INFO: ::ffff:127.0.0.1:57636 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1741gitlab # [ 203.474819] gitaly[898]: time="2026-08-20T05:56:19.541Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVSCA9VZZ15XMPN8V7F6F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:56:49.039" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:19.540" grpc.time_ms=0.713 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1742gitlab # [ 203.595949] gitaly[898]: time="2026-08-20T05:56:19.662Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVSCA9VZZ15XMPN8V7F6F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:56:29.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:19.652" grpc.time_ms=9.6 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1743gitlab # [ 203.666576] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/887f27e7d697883edeccf41f10639c0a5316948f HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2661744gitlab # [ 203.672236] nixbot[2614]: {"ts": "2026-08-20T05:56:19.733Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/887f27e7d697883edeccf41f10639c0a5316948f \"HTTP/1.1 201 Created\""}1745gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1746gitlab # [ 204.481157] nixbot[2614]: INFO: ::ffff:127.0.0.1:57644 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1747gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1748gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1749gitlab # [ 205.518126] nixbot[2614]: INFO: ::ffff:127.0.0.1:57646 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1750gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1751gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1752gitlab # [ 206.554817] nixbot[2614]: INFO: ::ffff:127.0.0.1:57660 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1753gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1754gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1755gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1756gitlab # [ 207.593480] nixbot[2614]: INFO: ::ffff:127.0.0.1:57666 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1757gitlab # [ 208.113190] nix-daemon[2819]: accepted connection from pid 2926, user nixbot1758gitlab # [ 208.218076] gitaly[898]: time="2026-08-20T05:56:24.283Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVY0MZFW4JTF5969DQVCR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:56:54.281" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:24.282" grpc.time_ms=0.933 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1759gitlab # [ 208.262750] gitaly[898]: time="2026-08-20T05:56:24.328Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVY0MZFW4JTF5969DQVCR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:56:34.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:24.317" grpc.time_ms=11.141 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1760gitlab # [ 208.355671] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/887f27e7d697883edeccf41f10639c0a5316948f HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2081761gitlab # [ 208.361950] nixbot[2614]: {"ts": "2026-08-20T05:56:24.427Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/887f27e7d697883edeccf41f10639c0a5316948f \"HTTP/1.1 201 Created\""}1762gitlab # [ 208.467201] nix-daemon[2819]: accepted connection from pid 2940, user nixbot1763gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1764gitlab # [ 208.582125] gitaly[898]: time="2026-08-20T05:56:24.648Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVYC32HVQCKP1CC6EH8NY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:24.636" grpc.time_ms=11.844 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc1765gitlab # [ 208.604239] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:24 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 681766gitlab # [ 208.627151] nixbot[2614]: INFO: ::ffff:127.0.0.1:57682 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1767gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1768gitlab # [ 208.666917] gitaly[898]: time="2026-08-20T05:56:24.733Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVYF4XDK99ZQ7B6DDMZV5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:24.723" pid=898 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1769gitlab # [ 208.685782] gitaly[898]: time="2026-08-20T05:56:24.733Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVYF4XDK99ZQ7B6DDMZV5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:24.723" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc1770gitlab # [ 208.703278] gitaly[898]: time="2026-08-20T05:56:24.769Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVYF4XDK99ZQ7B6DDMZV5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:24.723" grpc.time_ms=46.374 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc1771gitlab # [ 208.703820] gitlab-workhorse[822]: time="2026-08-20T05:56:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671772gitlab # [ 208.704462] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 931773gitlab # [ 208.766326] gitaly[898]: time="2026-08-20T05:56:24.832Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVYJ5JS0E26M9R3SHH8AS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:24.820" pid=898 remote_ip="2001:db8:1::1" request_sha=83b5f8ba994f213a111483be9fef4a764dfee943 response_bytes=337 span.kind=server system=grpc1774gitlab # [ 208.766575] gitaly[898]: time="2026-08-20T05:56:24.832Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1191 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVYJ5JS0E26M9R3SHH8AS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:24.820" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc1775gitlab # [ 208.767719] gitaly[898]: time="2026-08-20T05:56:24.832Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1191 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVYJ5JS0E26M9R3SHH8AS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:24.820" grpc.time_ms=12.105 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc1776gitlab # [ 208.805167] gitlab-workhorse[822]: time="2026-08-20T05:56:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3371777gitlab # [ 208.805789] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 981778gitlab # [ 208.902317] nix-daemon[2819]: accepted connection from pid 2973, user nixbot1779gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1780gitlab # [ 209.666474] nixbot[2614]: INFO: ::ffff:127.0.0.1:57684 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1781gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1782gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1783gitlab # [ 210.704416] nixbot[2614]: INFO: ::ffff:127.0.0.1:57686 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1784gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1785gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1786gitlab # [ 211.740961] nixbot[2614]: INFO: ::ffff:127.0.0.1:57694 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1787gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1788gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1789gitlab # [ 212.777457] nixbot[2614]: INFO: ::ffff:127.0.0.1:57710 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1790gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1791gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1792gitlab # [ 213.815329] nixbot[2614]: INFO: ::ffff:127.0.0.1:40148 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1793gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1794gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1795gitlab # [ 214.852879] nixbot[2614]: INFO: ::ffff:127.0.0.1:40162 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1796gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1797gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1798gitlab # [ 215.890602] nixbot[2614]: INFO: ::ffff:127.0.0.1:40174 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1799gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1800gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1801gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.03 seconds)1802gitlab # [ 216.927869] nixbot[2614]: INFO: ::ffff:127.0.0.1:40190 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1803gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1804gitlab # [ 217.959916] nixbot[2614]: INFO: ::ffff:127.0.0.1:40206 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1805gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.03 seconds)1806gitlab # [ 218.934933] sidekiq-cluster[2609]: 2026-08-20T05:56:35.000Z pid=2609 tid=xax INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2609, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433008640}1807gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1808gitlab # [ 218.990407] nixbot[2614]: INFO: ::ffff:127.0.0.1:40214 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1809gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.03 seconds)1810gitlab # [ 219.115264] sidekiq-cluster[2609]: W, [2026-08-20T05:56:35.181146 #2609] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1811gitlab # [ 219.152594] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:56:35.218Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1812gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1813gitlab # [ 220.023444] nixbot[2614]: INFO: ::ffff:127.0.0.1:40224 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1814gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.03 seconds)1815gitlab # [ 220.899628] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:56:36.964Z","message":"GitLab reliable fetch activated!"}1816gitlab # [ 220.900348] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:56:36.965Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1817gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1818gitlab # [ 221.057238] nixbot[2614]: INFO: ::ffff:127.0.0.1:40232 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1819gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.03 seconds)1820gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1821gitlab # [ 222.092471] nixbot[2614]: INFO: ::ffff:127.0.0.1:40238 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1822gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.03 seconds)1823gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1824gitlab # [ 223.127674] nixbot[2614]: INFO: ::ffff:127.0.0.1:60024 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1825gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1826gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1827gitlab # [ 224.164234] nixbot[2614]: INFO: ::ffff:127.0.0.1:60028 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1828gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1829gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1830gitlab # [ 225.201172] nixbot[2614]: INFO: ::ffff:127.0.0.1:60030 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1831gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1832gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1833gitlab # [ 226.237167] nixbot[2614]: INFO: ::ffff:127.0.0.1:60032 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1834gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1835gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1836gitlab # [ 227.273281] nixbot[2614]: INFO: ::ffff:127.0.0.1:60036 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1837gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1838gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1839gitlab # [ 228.309090] nixbot[2614]: INFO: ::ffff:127.0.0.1:60052 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1840gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.03 seconds)1841gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1842gitlab # [ 229.344965] nixbot[2614]: INFO: ::ffff:127.0.0.1:60060 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1843gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.03 seconds)1844gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1845gitlab # [ 230.380098] nixbot[2614]: INFO: ::ffff:127.0.0.1:60076 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1846gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.03 seconds)1847gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1848gitlab # [ 231.415394] nixbot[2614]: INFO: ::ffff:127.0.0.1:60086 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1849gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1850gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1851gitlab # [ 232.452259] nixbot[2614]: INFO: ::ffff:127.0.0.1:60100 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1852gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1853gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1854gitlab # [ 233.489432] nixbot[2614]: INFO: ::ffff:127.0.0.1:53014 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1855gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1856gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1857gitlab # [ 234.526244] nixbot[2614]: INFO: ::ffff:127.0.0.1:53030 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1858gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1859gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1860gitlab # [ 235.563584] nixbot[2614]: INFO: ::ffff:127.0.0.1:53034 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1861gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1862gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1863gitlab # [ 236.600714] nixbot[2614]: INFO: ::ffff:127.0.0.1:53046 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1864gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1865gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1866gitlab # [ 237.638481] nixbot[2614]: INFO: ::ffff:127.0.0.1:53054 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1867gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1868gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1869gitlab # [ 238.676152] nixbot[2614]: INFO: ::ffff:127.0.0.1:53058 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1870gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.03 seconds)1871gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1872gitlab # [ 239.713176] nixbot[2614]: INFO: ::ffff:127.0.0.1:53064 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1873gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1874gitlab # [ 240.583169] postgres[3086]: [3086] ERROR: relation "table_without_models" does not exist1875gitlab # [ 240.583994] postgres[3086]: [3086] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1876gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1877gitlab # [ 240.751059] nixbot[2614]: INFO: ::ffff:127.0.0.1:53076 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1878gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1879gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1880gitlab # [ 241.789461] nixbot[2614]: INFO: ::ffff:127.0.0.1:53090 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1881gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1882gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1883gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1884gitlab # [ 242.828331] nixbot[2614]: INFO: ::ffff:127.0.0.1:53106 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1885gitlab # [ 242.960897] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:56:59.026Z","message":"Booted Rails 7.2.3.1 application in production environment"}1886gitlab # [ 242.963082] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:56:59.026Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1887gitlab # [ 242.965119] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:56:59.026Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1888gitlab # [ 242.966716] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:56:59.026Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1889gitlab # [ 242.968426] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:56:59.028Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1890gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1891gitlab # [ 243.863781] nixbot[2614]: INFO: ::ffff:127.0.0.1:39858 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1892gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1893gitlab # [ 244.360953] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.426Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a0726f6f0f3c6a7ff7de5c4c","created_at":"2026-08-20T05:56:04.171Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71657aa003984453","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5893d6c56903ca38319fced33eedb241","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.182Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a0726f6f0f3c6a7ff7de5c4c: start","job_status":"start","queue_duration_s":56.243026,"scheduling_latency_s":56.243114}1894gitlab # [ 244.420580] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.486Z","message":"No existing merge request to be cleaned up."}1895gitlab # [ 244.437449] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.503Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a0726f6f0f3c6a7ff7de5c4c","created_at":"2026-08-20T05:56:04.171Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71657aa003984453","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5893d6c56903ca38319fced33eedb241","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.182Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a0726f6f0f3c6a7ff7de5c4c: done: 0.07762 sec","job_status":"done","queue_duration_s":56.243026,"scheduling_latency_s":56.243114,"redis_calls":26,"redis_duration_s":0.006055,"redis_read_bytes":786,"redis_write_bytes":2890,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003707,"redis_feature_flag_read_bytes":778,"redis_feature_flag_write_bytes":1868,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001424,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":8,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.07762,"completed_at":"2026-08-20T05:57:00.503Z","load_balancing_strategy":"primary","db_duration_s":0.013587,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1896gitlab # [ 244.502402] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.504Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c51b282d6816242e42b72ce4","created_at":"2026-08-20T05:56:04.171Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71657aa003984453","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5893d6c56903ca38319fced33eedb241","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.182Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c51b282d6816242e42b72ce4: start","job_status":"start","queue_duration_s":56.321794,"scheduling_latency_s":56.321812}1897gitlab # [ 244.512339] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.512Z","message":"No existing merge request to be cleaned up."}1898gitlab # [ 244.513790] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.517Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c51b282d6816242e42b72ce4","created_at":"2026-08-20T05:56:04.171Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71657aa003984453","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5893d6c56903ca38319fced33eedb241","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.182Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c51b282d6816242e42b72ce4: done: 0.012798 sec","job_status":"done","queue_duration_s":56.321794,"scheduling_latency_s":56.321812,"redis_calls":10,"redis_duration_s":0.002123,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001287,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012798,"completed_at":"2026-08-20T05:57:00.517Z","load_balancing_strategy":"primary","db_duration_s":0.001706,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1899gitlab # [ 244.545314] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.518Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fb3fcb0c5caf727718d749fb","created_at":"2026-08-20T05:56:04.171Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71657aa003984453","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5893d6c56903ca38319fced33eedb241","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.182Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fb3fcb0c5caf727718d749fb: start","job_status":"start","queue_duration_s":56.335712,"scheduling_latency_s":56.335727}1900gitlab # [ 244.556176] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.525Z","message":"No existing merge request to be cleaned up."}1901gitlab # [ 244.557961] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.530Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fb3fcb0c5caf727718d749fb","created_at":"2026-08-20T05:56:04.171Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71657aa003984453","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5893d6c56903ca38319fced33eedb241","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.182Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fb3fcb0c5caf727718d749fb: done: 0.012184 sec","job_status":"done","queue_duration_s":56.335712,"scheduling_latency_s":56.335727,"redis_calls":10,"redis_duration_s":0.002222,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000897,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001325,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012184,"completed_at":"2026-08-20T05:57:00.530Z","load_balancing_strategy":"primary","db_duration_s":0.001621,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1902gitlab # [ 244.559109] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.531Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"b8961c34e02df5b447c563e8","created_at":"2026-08-20T05:56:04.172Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9ee23e132da67cb57dc0365e6296859","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.183Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-b8961c34e02df5b447c563e8: start","job_status":"start","queue_duration_s":56.348329,"scheduling_latency_s":56.348344}1903gitlab # [ 244.564358] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.545Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"b8961c34e02df5b447c563e8","created_at":"2026-08-20T05:56:04.172Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9ee23e132da67cb57dc0365e6296859","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.183Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-b8961c34e02df5b447c563e8: done: 0.013639 sec","job_status":"done","queue_duration_s":56.348329,"scheduling_latency_s":56.348344,"redis_calls":13,"redis_duration_s":0.002823,"redis_read_bytes":138,"redis_write_bytes":1285,"redis_cache_calls":2,"redis_cache_duration_s":0.000603,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000622,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":416,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000451,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000301156,"duration_s":0.013639,"completed_at":"2026-08-20T05:57:00.545Z","load_balancing_strategy":"primary","db_duration_s":0.000482,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1904gitlab # [ 244.601708] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.546Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"476062f4553fe83005aa03cc","created_at":"2026-08-20T05:56:04.202Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adf65c481d750fede1b256113adaa255","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.204Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-476062f4553fe83005aa03cc: start","job_status":"start","queue_duration_s":56.341777,"scheduling_latency_s":56.341791}1905gitlab # [ 244.613534] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.556Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1906gitlab # [ 244.616616] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.560Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"476062f4553fe83005aa03cc","created_at":"2026-08-20T05:56:04.202Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adf65c481d750fede1b256113adaa255","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.204Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-476062f4553fe83005aa03cc: done: 0.013861 sec","job_status":"done","queue_duration_s":56.341777,"scheduling_latency_s":56.341791,"redis_calls":11,"redis_duration_s":0.0025770000000000003,"redis_read_bytes":9,"redis_write_bytes":1589,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001026,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":768,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000441,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013861,"completed_at":"2026-08-20T05:57:00.560Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000886,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1907gitlab # [ 244.662492] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.561Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"e0547ecec7e24ba971d32775","created_at":"2026-08-20T05:56:04.245Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce92011e42b8b08d575939df026af360","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:56:04.249Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-e0547ecec7e24ba971d32775: start","job_status":"start","queue_duration_s":56.311856,"scheduling_latency_s":56.311871}1908gitlab # [ 244.663083] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.570Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1909gitlab # [ 244.664364] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.575Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"e0547ecec7e24ba971d32775","created_at":"2026-08-20T05:56:04.245Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce92011e42b8b08d575939df026af360","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:56:04.249Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-e0547ecec7e24ba971d32775: done: 0.013315 sec","job_status":"done","queue_duration_s":56.311856,"scheduling_latency_s":56.311871,"redis_calls":11,"redis_duration_s":0.002331,"redis_read_bytes":9,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000846,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000375,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013315,"completed_at":"2026-08-20T05:57:00.574Z","load_balancing_strategy":"primary","db_duration_s":0.000772,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1910gitlab # [ 244.724077] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.576Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b5a43539f1e95a36eb38f7ec","created_at":"2026-08-20T05:56:04.275Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"618a18c66b441041f7441b03cd0ae197","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.279Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b5a43539f1e95a36eb38f7ec: start","job_status":"start","queue_duration_s":56.296496,"scheduling_latency_s":56.296511}1911gitlab # [ 244.724750] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.596Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b5a43539f1e95a36eb38f7ec","created_at":"2026-08-20T05:56:04.275Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"618a18c66b441041f7441b03cd0ae197","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.279Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b5a43539f1e95a36eb38f7ec: done: 0.020182 sec","job_status":"done","queue_duration_s":56.296496,"scheduling_latency_s":56.296511,"redis_calls":13,"redis_duration_s":0.002901,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000897,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":708,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00107,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00039614,"exclusive_lock_hold_duration_s":0.006047417,"duration_s":0.020182,"completed_at":"2026-08-20T05:57:00.596Z","load_balancing_strategy":"primary","db_duration_s":0.004367,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1912gitlab # [ 244.742155] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.597Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"718ed0e675358d487d5d5034","created_at":"2026-08-20T05:56:04.303Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d96df1d38a315c481fb4c331261eb55e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.309Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-718ed0e675358d487d5d5034: start","job_status":"start","queue_duration_s":56.288341,"scheduling_latency_s":56.288354}1913gitlab # [ 244.779977] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.606Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1914gitlab # [ 244.780658] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.610Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"718ed0e675358d487d5d5034","created_at":"2026-08-20T05:56:04.303Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d96df1d38a315c481fb4c331261eb55e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.309Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-718ed0e675358d487d5d5034: done: 0.013353 sec","job_status":"done","queue_duration_s":56.288341,"scheduling_latency_s":56.288354,"redis_calls":11,"redis_duration_s":0.002366,"redis_read_bytes":9,"redis_write_bytes":1507,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000936,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":736,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001053,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000377,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013353,"completed_at":"2026-08-20T05:57:00.610Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000813,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1915gitlab # [ 244.816732] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:00.612Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"146b8966ddb0f6a1f7c9fd44","created_at":"2026-08-20T05:56:04.315Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1f546203eba26caf6e6c9b5dac5d027","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.324Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-146b8966ddb0f6a1f7c9fd44: start","job_status":"start","queue_duration_s":56.287087,"scheduling_latency_s":56.287102}1916gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1917gitlab # [ 244.904904] nixbot[2614]: INFO: ::ffff:127.0.0.1:39874 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1918gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1919gitlab # [ 244.967135] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.033Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"146b8966ddb0f6a1f7c9fd44","created_at":"2026-08-20T05:56:04.315Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1f546203eba26caf6e6c9b5dac5d027","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.324Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-146b8966ddb0f6a1f7c9fd44: done: 0.421023 sec","job_status":"done","queue_duration_s":56.287087,"scheduling_latency_s":56.287102,"redis_calls":13,"redis_duration_s":0.003142,"redis_read_bytes":139,"redis_write_bytes":1565,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000681,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":437,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001237,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001224,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000377143,"exclusive_lock_hold_duration_s":0.407096712,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.421023,"completed_at":"2026-08-20T05:57:01.032Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022387,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1920gitlab # [ 244.968407] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.034Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"8537bff45ccd43b4e87ad1fa","created_at":"2026-08-20T05:56:04.350Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a5ea7b8099d56a16964e37de556625a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.354Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-8537bff45ccd43b4e87ad1fa: start","job_status":"start","queue_duration_s":56.679855,"scheduling_latency_s":56.679868}1921gitlab # [ 244.993394] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.053Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"8537bff45ccd43b4e87ad1fa","created_at":"2026-08-20T05:56:04.350Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a5ea7b8099d56a16964e37de556625a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.354Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-8537bff45ccd43b4e87ad1fa: done: 0.01931 sec","job_status":"done","queue_duration_s":56.679855,"scheduling_latency_s":56.679868,"redis_calls":11,"redis_duration_s":0.00244,"redis_read_bytes":9,"redis_write_bytes":1341,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000924,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":660,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001104,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01931,"completed_at":"2026-08-20T05:57:01.053Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00361,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1922gitlab # [ 245.054743] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b964046b00c0c5b37a31c5aa","created_at":"2026-08-20T05:56:04.414Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7923f5b0a33df3e727b667bfd81c7ec9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.417Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b964046b00c0c5b37a31c5aa: start","job_status":"start","queue_duration_s":56.637228,"scheduling_latency_s":56.637245}1923gitlab # [ 245.058616] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.109Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b964046b00c0c5b37a31c5aa","created_at":"2026-08-20T05:56:04.414Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7923f5b0a33df3e727b667bfd81c7ec9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.417Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b964046b00c0c5b37a31c5aa: done: 0.054339 sec","job_status":"done","queue_duration_s":56.637228,"scheduling_latency_s":56.637245,"redis_calls":13,"redis_duration_s":0.003011,"redis_read_bytes":11,"redis_write_bytes":1921,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000885,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":752,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000534984,"exclusive_lock_hold_duration_s":0.025444295,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.054339,"completed_at":"2026-08-20T05:57:01.109Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024173,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1924gitlab # [ 245.097255] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.110Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"df69f7b3d6c11981262a5066","created_at":"2026-08-20T05:56:04.428Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"027da65d0c89f5f363ad347bf107ec9f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.432Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-df69f7b3d6c11981262a5066: start","job_status":"start","queue_duration_s":56.677851,"scheduling_latency_s":56.677865}1925gitlab # [ 245.106628] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.126Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"df69f7b3d6c11981262a5066","created_at":"2026-08-20T05:56:04.428Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"027da65d0c89f5f363ad347bf107ec9f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.432Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-df69f7b3d6c11981262a5066: done: 0.016141 sec","job_status":"done","queue_duration_s":56.677851,"scheduling_latency_s":56.677865,"redis_calls":13,"redis_duration_s":0.002593,"redis_read_bytes":11,"redis_write_bytes":1874,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.00125,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1043,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000387,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016141,"completed_at":"2026-08-20T05:57:01.126Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001138,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1926gitlab # [ 245.162194] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.131Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e6ac2c7b1268d321c85b9cc5","created_at":"2026-08-20T05:56:04.448Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.452Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e6ac2c7b1268d321c85b9cc5: start","job_status":"start","queue_duration_s":56.678833,"scheduling_latency_s":56.678885}1927gitlab # [ 245.163247] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.226Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e6ac2c7b1268d321c85b9cc5","created_at":"2026-08-20T05:56:04.448Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.452Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e6ac2c7b1268d321c85b9cc5: done: 0.095164 sec","job_status":"done","queue_duration_s":56.678833,"scheduling_latency_s":56.678885,"redis_calls":72,"redis_duration_s":0.0109,"redis_read_bytes":120,"redis_write_bytes":42965,"redis_feature_flag_calls":12,"redis_feature_flag_duration_s":0.002452,"redis_feature_flag_read_bytes":12,"redis_feature_flag_write_bytes":1856,"redis_queues_calls":2,"redis_queues_duration_s":0.000578,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.007276,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000594,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.095164,"completed_at":"2026-08-20T05:57:01.226Z","load_balancing_strategy":"primary","db_duration_s":0.002835,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1928gitlab # [ 245.215262] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.227Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"3873479b48e024c7230983eb","created_at":"2026-08-20T05:56:04.462Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7bb87d9f8c9dd0fd86fc7a5edd0a3f9e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.465Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-3873479b48e024c7230983eb: start","job_status":"start","queue_duration_s":56.761822,"scheduling_latency_s":56.761843}1929gitlab # [ 245.293419] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.359Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"3873479b48e024c7230983eb","created_at":"2026-08-20T05:56:04.462Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7bb87d9f8c9dd0fd86fc7a5edd0a3f9e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.465Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-3873479b48e024c7230983eb: done: 0.132045 sec","job_status":"done","queue_duration_s":56.761822,"scheduling_latency_s":56.761843,"redis_calls":15,"redis_duration_s":0.002584,"redis_read_bytes":13,"redis_write_bytes":1922,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.000805,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":935,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":132,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":132,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000294171,"exclusive_lock_hold_duration_s":0.115081107,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.132045,"completed_at":"2026-08-20T05:57:01.359Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.038212,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1930gitlab # [ 245.294617] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.360Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"72a6a8d91e22f478f4eeef18","created_at":"2026-08-20T05:56:04.507Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f37c3fc2e6c9f19c1612975e6cb4668b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.510Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-72a6a8d91e22f478f4eeef18: start","job_status":"start","queue_duration_s":56.850045,"scheduling_latency_s":56.85006}1931gitlab # [ 245.357307] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.423Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"72a6a8d91e22f478f4eeef18","created_at":"2026-08-20T05:56:04.507Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f37c3fc2e6c9f19c1612975e6cb4668b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.510Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-72a6a8d91e22f478f4eeef18: done: 0.062598 sec","job_status":"done","queue_duration_s":56.850045,"scheduling_latency_s":56.85006,"redis_calls":17,"redis_duration_s":0.0404,"redis_read_bytes":15,"redis_write_bytes":2228,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.039118,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1517,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000361,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.062598,"completed_at":"2026-08-20T05:57:01.423Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00563,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1932gitlab # [ 245.393879] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.459Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"612bd43f001235d4d411a22d","created_at":"2026-08-20T05:56:04.526Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b7320b6c91346763da96072318bb23ac","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.534Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-612bd43f001235d4d411a22d: start","job_status":"start","queue_duration_s":56.924226,"scheduling_latency_s":56.924293}1933gitlab # [ 245.691908] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.757Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"612bd43f001235d4d411a22d","created_at":"2026-08-20T05:56:04.526Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b7320b6c91346763da96072318bb23ac","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.534Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-612bd43f001235d4d411a22d: done: 0.298911 sec","job_status":"done","queue_duration_s":56.924226,"scheduling_latency_s":56.924293,"redis_calls":566,"redis_duration_s":0.10777500000000001,"redis_read_bytes":564,"redis_write_bytes":49420,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00126,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":660,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001449,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.105066,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.214095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.298911,"completed_at":"2026-08-20T05:57:01.757Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001528,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1934gitlab # [ 245.760884] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.826Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"281642eadacf990186fc8302","created_at":"2026-08-20T05:56:04.548Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf25b73f012fc78df3fbcbd8a60a78bc","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.553Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-281642eadacf990186fc8302: start","job_status":"start","queue_duration_s":57.273433,"scheduling_latency_s":57.273465}1935gitlab # [ 245.812775] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.878Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"281642eadacf990186fc8302","created_at":"2026-08-20T05:56:04.548Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf25b73f012fc78df3fbcbd8a60a78bc","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.553Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-281642eadacf990186fc8302: done: 0.0514 sec","job_status":"done","queue_duration_s":57.273433,"scheduling_latency_s":57.273465,"redis_calls":11,"redis_duration_s":0.00218,"redis_read_bytes":9,"redis_write_bytes":1594,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000728,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":768,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000357,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.0514,"completed_at":"2026-08-20T05:57:01.878Z","load_balancing_strategy":"primary","db_duration_s":0.011914,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1936gitlab # [ 245.861103] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.926Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"f1adc5f09d75616ecb8961db","created_at":"2026-08-20T05:56:04.563Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"5d83de689a8ff03fd230f80d461e3690","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.617Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-f1adc5f09d75616ecb8961db: start","job_status":"start","queue_duration_s":57.309369,"scheduling_latency_s":57.309416}1937gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1938gitlab # [ 245.897517] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.963Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"f1adc5f09d75616ecb8961db","created_at":"2026-08-20T05:56:04.563Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"5d83de689a8ff03fd230f80d461e3690","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.617Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-f1adc5f09d75616ecb8961db: done: 0.036328 sec","job_status":"done","queue_duration_s":57.309369,"scheduling_latency_s":57.309416,"redis_calls":11,"redis_duration_s":0.002175,"redis_read_bytes":137,"redis_write_bytes":1330,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000597,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":464,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001192,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000386,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000397537,"duration_s":0.036328,"completed_at":"2026-08-20T05:57:01.962Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00073,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1939gitlab # [ 245.932157] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:01.998Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e0488d6405451f0dcef80cdc","created_at":"2026-08-20T05:56:04.654Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e729cc91a9572916421fd92e643bf18d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.660Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e0488d6405451f0dcef80cdc: start","job_status":"start","queue_duration_s":57.337502,"scheduling_latency_s":57.337524}1940gitlab # [ 245.957785] nixbot[2614]: INFO: ::ffff:127.0.0.1:39884 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1941gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.05 seconds)1942gitlab # [ 246.000245] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.065Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e0488d6405451f0dcef80cdc","created_at":"2026-08-20T05:56:04.654Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e729cc91a9572916421fd92e643bf18d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.660Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e0488d6405451f0dcef80cdc: done: 0.067723 sec","job_status":"done","queue_duration_s":57.337502,"scheduling_latency_s":57.337524,"redis_calls":13,"redis_duration_s":0.003605,"redis_read_bytes":11,"redis_write_bytes":1910,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000856,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":748,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001835,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000811556,"exclusive_lock_hold_duration_s":0.022856257,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.067723,"completed_at":"2026-08-20T05:57:02.065Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012863,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1943gitlab # [ 246.047291] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.113Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"bdc2076ddfa0a5079ce2f753","created_at":"2026-08-20T05:56:04.683Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15a39c9c86f4ad0e430bccb70645424f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.690Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-bdc2076ddfa0a5079ce2f753: start","job_status":"start","queue_duration_s":57.422376,"scheduling_latency_s":57.422418}1944gitlab # [ 246.067993] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.134Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1945gitlab # [ 246.078760] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.144Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"bdc2076ddfa0a5079ce2f753","created_at":"2026-08-20T05:56:04.683Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15a39c9c86f4ad0e430bccb70645424f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.690Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-bdc2076ddfa0a5079ce2f753: done: 0.031377 sec","job_status":"done","queue_duration_s":57.422376,"scheduling_latency_s":57.422418,"redis_calls":11,"redis_duration_s":0.003206,"redis_read_bytes":9,"redis_write_bytes":1598,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001198,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":772,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001444,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000564,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031377,"completed_at":"2026-08-20T05:57:02.144Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001604,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1946gitlab # [ 246.114753] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.180Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"31fff254fc798b016bd3e506","created_at":"2026-08-20T05:56:04.706Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50fde9ca93caf2aad724b25f6bb6884c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.713Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-31fff254fc798b016bd3e506: start","job_status":"start","queue_duration_s":57.467059,"scheduling_latency_s":57.467101}1947gitlab # [ 246.154390] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.219Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"31fff254fc798b016bd3e506","created_at":"2026-08-20T05:56:04.706Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50fde9ca93caf2aad724b25f6bb6884c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.713Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-31fff254fc798b016bd3e506: done: 0.039446 sec","job_status":"done","queue_duration_s":57.467059,"scheduling_latency_s":57.467101,"redis_calls":11,"redis_duration_s":0.002101,"redis_read_bytes":9,"redis_write_bytes":1516,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000783,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":740,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000981,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000337,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039446,"completed_at":"2026-08-20T05:57:02.219Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001503,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1948gitlab # [ 246.189453] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.255Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"21b2e4a6c888ad1f0106c00d","created_at":"2026-08-20T05:56:04.761Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"29860a9c6134f12a46263653f64ad00e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:56:04.765Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-21b2e4a6c888ad1f0106c00d: start","job_status":"start","queue_duration_s":57.48949,"scheduling_latency_s":57.489534}1949gitlab # [ 246.217532] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.283Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1950gitlab # [ 246.230448] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.296Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"21b2e4a6c888ad1f0106c00d","created_at":"2026-08-20T05:56:04.761Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"29860a9c6134f12a46263653f64ad00e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:56:04.765Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-21b2e4a6c888ad1f0106c00d: done: 0.040946 sec","job_status":"done","queue_duration_s":57.48949,"scheduling_latency_s":57.489534,"redis_calls":11,"redis_duration_s":0.003985,"redis_read_bytes":9,"redis_write_bytes":1557,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000822,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":756,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002816,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000347,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040946,"completed_at":"2026-08-20T05:57:02.296Z","load_balancing_strategy":"primary","db_duration_s":0.001704,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1951gitlab # [ 246.264683] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.330Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"dad51cedee644b876c1cd62c","created_at":"2026-08-20T05:56:04.787Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d2fc0f3a6061407a7bf976846cc1118","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.791Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-dad51cedee644b876c1cd62c: start","job_status":"start","queue_duration_s":57.538999,"scheduling_latency_s":57.539042}1952gitlab # [ 246.284884] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.351Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1953gitlab # [ 246.295972] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.361Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"dad51cedee644b876c1cd62c","created_at":"2026-08-20T05:56:04.787Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d2fc0f3a6061407a7bf976846cc1118","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:04.791Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-dad51cedee644b876c1cd62c: done: 0.031185 sec","job_status":"done","queue_duration_s":57.538999,"scheduling_latency_s":57.539042,"redis_calls":11,"redis_duration_s":0.003526,"redis_read_bytes":9,"redis_write_bytes":1498,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001157,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":732,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001828,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000541,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031185,"completed_at":"2026-08-20T05:57:02.361Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001611,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1954gitlab # [ 246.330692] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.396Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7c0f09dadf446d46f9981a36","created_at":"2026-08-20T05:56:04.804Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"843a08090a96249a3196fa6841537086","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:56:04.807Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7c0f09dadf446d46f9981a36: start","job_status":"start","queue_duration_s":57.588963,"scheduling_latency_s":57.589005}1955gitlab # [ 246.384669] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.450Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7c0f09dadf446d46f9981a36","created_at":"2026-08-20T05:56:04.804Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-71743a9480f54f0b","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"843a08090a96249a3196fa6841537086","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:56:04.807Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7c0f09dadf446d46f9981a36: done: 0.053695 sec","job_status":"done","queue_duration_s":57.588963,"scheduling_latency_s":57.589005,"redis_calls":11,"redis_duration_s":0.002234,"redis_read_bytes":9,"redis_write_bytes":1449,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000752,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":708,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001115,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053695,"completed_at":"2026-08-20T05:57:02.450Z","load_balancing_strategy":"primary","db_duration_s":0.006101,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1956gitlab # [ 246.424984] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.490Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"8bea043c6f2f5965b636f72f","created_at":"2026-08-20T05:56:08.010Z","trace_propagation_headers":{"sentry-trace":"5e2fb989d76446deaa0070e66a2d3e9f-5252e28d81f04ef5","baggage":"sentry-trace_id=5e2fb989d76446deaa0070e66a2d3e9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVD45VT3FKV47TZ4ZRV27","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:08.038Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-8bea043c6f2f5965b636f72f: start","job_status":"start","queue_duration_s":54.451295,"scheduling_latency_s":54.451339}1957gitlab # [ 246.552204] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.618Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"8bea043c6f2f5965b636f72f","created_at":"2026-08-20T05:56:08.010Z","trace_propagation_headers":{"sentry-trace":"5e2fb989d76446deaa0070e66a2d3e9f-5252e28d81f04ef5","baggage":"sentry-trace_id=5e2fb989d76446deaa0070e66a2d3e9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVD45VT3FKV47TZ4ZRV27","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:08.038Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-8bea043c6f2f5965b636f72f: done: 0.128043 sec","job_status":"done","queue_duration_s":54.451295,"scheduling_latency_s":54.451339,"redis_calls":13,"redis_duration_s":0.002944,"redis_read_bytes":138,"redis_write_bytes":1593,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000604,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":428,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.080036709,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.128043,"completed_at":"2026-08-20T05:57:02.618Z","load_balancing_strategy":"primary","db_duration_s":0.032705,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1958gitlab # [ 246.626168] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.692Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"2223b253559537be88896800","created_at":"2026-08-20T05:56:08.050Z","trace_propagation_headers":{"sentry-trace":"5e2fb989d76446deaa0070e66a2d3e9f-5252e28d81f04ef5","baggage":"sentry-trace_id=5e2fb989d76446deaa0070e66a2d3e9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVD45VT3FKV47TZ4ZRV27","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:08.055Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-2223b253559537be88896800: start","job_status":"start","queue_duration_s":54.636912,"scheduling_latency_s":54.636944}1959gitlab # [ 246.745617] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.811Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"2223b253559537be88896800","created_at":"2026-08-20T05:56:08.050Z","trace_propagation_headers":{"sentry-trace":"5e2fb989d76446deaa0070e66a2d3e9f-5252e28d81f04ef5","baggage":"sentry-trace_id=5e2fb989d76446deaa0070e66a2d3e9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVD45VT3FKV47TZ4ZRV27","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:08.055Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-2223b253559537be88896800: done: 0.119423 sec","job_status":"done","queue_duration_s":54.636912,"scheduling_latency_s":54.636944,"redis_calls":14,"redis_duration_s":0.003035,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000606,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001401,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.075117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.082335605,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.119423,"completed_at":"2026-08-20T05:57:02.811Z","load_balancing_strategy":"primary","db_duration_s":0.025636,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1960gitlab # [ 246.817991] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:02.883Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"3c15b03907ae65b343708088","created_at":"2026-08-20T05:56:08.541Z","trace_propagation_headers":{"sentry-trace":"5e2fb989d76446deaa0070e66a2d3e9f-5252e28d81f04ef5","baggage":"sentry-trace_id=5e2fb989d76446deaa0070e66a2d3e9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVD45VT3FKV47TZ4ZRV27","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:08.547Z","job_size_bytes":5,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-3c15b03907ae65b343708088: start","job_status":"start","queue_duration_s":54.33665,"scheduling_latency_s":54.336681}1961gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1962gitlab # [ 246.984164] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:03.050Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"3c15b03907ae65b343708088","created_at":"2026-08-20T05:56:08.541Z","trace_propagation_headers":{"sentry-trace":"5e2fb989d76446deaa0070e66a2d3e9f-5252e28d81f04ef5","baggage":"sentry-trace_id=5e2fb989d76446deaa0070e66a2d3e9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVD45VT3FKV47TZ4ZRV27","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:08.547Z","job_size_bytes":5,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-3c15b03907ae65b343708088: done: 0.16628 sec","job_status":"done","queue_duration_s":54.33665,"scheduling_latency_s":54.336681,"redis_calls":12,"redis_duration_s":0.003334,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.0009,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001828,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000606,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.116085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000282718,"duration_s":0.16628,"completed_at":"2026-08-20T05:57:03.049Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027339,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1963gitlab # [ 246.985420] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:03.051Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"e3d11b583ab3e6251a595742","created_at":"2026-08-20T05:56:08.570Z","trace_propagation_headers":{"sentry-trace":"5e2fb989d76446deaa0070e66a2d3e9f-5252e28d81f04ef5","baggage":"sentry-trace_id=5e2fb989d76446deaa0070e66a2d3e9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVD45VT3FKV47TZ4ZRV27","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:08.573Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-e3d11b583ab3e6251a595742: start","job_status":"start","queue_duration_s":54.477779,"scheduling_latency_s":54.4778}1964gitlab # [ 247.076789] nixbot[2614]: INFO: ::ffff:127.0.0.1:39886 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1965gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.12 seconds)1966gitlab # [ 247.178199] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:03.243Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"e3d11b583ab3e6251a595742","created_at":"2026-08-20T05:56:08.570Z","trace_propagation_headers":{"sentry-trace":"5e2fb989d76446deaa0070e66a2d3e9f-5252e28d81f04ef5","baggage":"sentry-trace_id=5e2fb989d76446deaa0070e66a2d3e9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVD45VT3FKV47TZ4ZRV27","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:08.573Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-e3d11b583ab3e6251a595742: done: 0.19219 sec","job_status":"done","queue_duration_s":54.477779,"scheduling_latency_s":54.4778,"redis_calls":11,"redis_duration_s":0.002866,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000652,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0005,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.161,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.161,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.122536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000503136,"duration_s":0.19219,"completed_at":"2026-08-20T05:57:03.243Z","load_balancing_strategy":"primary","db_duration_s":0.068011,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1967gitlab # [ 247.179991] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:03.245Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"5a00bc6aa810e7ed9580fcf0","created_at":"2026-08-20T05:56:08.576Z","trace_propagation_headers":{"sentry-trace":"5e2fb989d76446deaa0070e66a2d3e9f-5252e28d81f04ef5","baggage":"sentry-trace_id=5e2fb989d76446deaa0070e66a2d3e9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVD45VT3FKV47TZ4ZRV27","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:08.579Z","job_size_bytes":89,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-5a00bc6aa810e7ed9580fcf0: start","job_status":"start","queue_duration_s":54.666036,"scheduling_latency_s":54.666076}1968gitlab # [ 247.307912] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:03.373Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"5a00bc6aa810e7ed9580fcf0","created_at":"2026-08-20T05:56:08.576Z","trace_propagation_headers":{"sentry-trace":"5e2fb989d76446deaa0070e66a2d3e9f-5252e28d81f04ef5","baggage":"sentry-trace_id=5e2fb989d76446deaa0070e66a2d3e9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVD45VT3FKV47TZ4ZRV27","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:08.579Z","job_size_bytes":89,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-5a00bc6aa810e7ed9580fcf0: done: 0.127187 sec","job_status":"done","queue_duration_s":54.666036,"scheduling_latency_s":54.666076,"redis_calls":11,"redis_duration_s":0.003389,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000926,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001889,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000574,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.081,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.081,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033516,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000524927,"duration_s":0.127187,"completed_at":"2026-08-20T05:57:03.373Z","load_balancing_strategy":"primary","db_duration_s":0.083008,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1969gitlab # [ 247.309825] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:03.375Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 887f27e7d697883edeccf41f10639c0a5316948f refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"8f65aba2994c9958b689232e","created_at":"2026-08-20T05:56:09.942Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-9db775e581744f83","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:09.946Z","job_size_bytes":185,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-8f65aba2994c9958b689232e: start","job_status":"start","queue_duration_s":53.429326,"scheduling_latency_s":53.429359}1970gitlab # [ 247.357363] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:03.398Z","message":"changes: \"0000000000000000000000000000000000000000 887f27e7d697883edeccf41f10639c0a5316948f refs/heads/master\\n\""}1971gitlab # [ 247.395410] gitaly[898]: time="2026-08-20T05:57:03.460Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:13.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:03.451" grpc.time_ms=9.081 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1972gitlab # [ 247.410865] gitaly[898]: time="2026-08-20T05:57:03.477Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:57:13.017" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:03.467" grpc.time_ms=8.965 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1973gitlab # [ 247.454461] gitaly[898]: time="2026-08-20T05:57:03.520Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T05:57:13.059" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:03.510" grpc.time_ms=10.285 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1974gitlab # [ 247.496175] gitaly[898]: time="2026-08-20T05:57:03.562Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:03.561" grpc.time_ms=1.268 pid=898 span.kind=server system=grpc1975gitlab # [ 247.534455] gitaly[898]: time="2026-08-20T05:57:03.600Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:03.599" grpc.time_ms=0.619 pid=898 span.kind=server system=grpc1976gitlab # [ 247.555853] gitaly[898]: time="2026-08-20T05:57:03.622Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 diskcache=7a7e2eb8-72a7-4c31-b994-3644635354cd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:57:13.077" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:03.527" pid=898 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1977gitlab # [ 247.556763] gitaly[898]: time="2026-08-20T05:57:03.622Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=92 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5299 command.oublock=8 command.real_time_ms=86 command.spawn_token_fork_ms=0 command.system_time_ms=53 command.user_time_ms=39 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:57:13.077" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:03.527" grpc.time_ms=94.348 pid=898 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1978gitlab # [ 247.594331] gitaly[898]: time="2026-08-20T05:57:03.660Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:57:13.209" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:03.660" grpc.time_ms=0.208 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1979gitlab # [ 247.613962] gitaly[898]: time="2026-08-20T05:57:03.680Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=941 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T05:57:13.216" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:03.667" grpc.time_ms=12.589 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1980gitlab # [ 247.699327] gitaly[898]: time="2026-08-20T05:57:03.765Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-20T05:57:33.057" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:03.758" grpc.time_ms=7.224 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1981gitlab # [ 247.720641] gitaly[898]: time="2026-08-20T05:57:03.786Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:57:13.005" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:03.786" grpc.time_ms=0.409 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1982gitlab # [ 247.728212] gitaly[898]: time="2026-08-20T05:57:03.794Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T05:57:13.010" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T05:57:03.790" grpc.time_ms=3.787 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1983gitlab # [ 247.751619] gitaly[898]: time="2026-08-20T05:57:03.817Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:13.032" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:03.812" grpc.time_ms=5.378 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1984gitlab # [ 247.764057] gitaly[898]: time="2026-08-20T05:57:03.830Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:13.043" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:03.823" grpc.time_ms=7.04 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1985gitlab # [ 247.786635] gitaly[898]: time="2026-08-20T05:57:03.852Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=961 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T05:57:33.143" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:03.843" grpc.time_ms=9.01 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1986gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'1987gitlab # [ 248.118168] nixbot[2614]: INFO: ::ffff:127.0.0.1:39888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK1988gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)1989gitlab # [ 248.210119] gitaly[898]: time="2026-08-20T05:57:04.276Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T05:57:14.004" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:04.275" grpc.time_ms=1.158 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1990gitlab # [ 248.266787] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:04.331Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 887f27e7d697883edeccf41f10639c0a5316948f refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"8f65aba2994c9958b689232e","created_at":"2026-08-20T05:56:09.942Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-9db775e581744f83","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:09.946Z","job_size_bytes":185,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-8f65aba2994c9958b689232e: done: 0.955988 sec","job_status":"done","queue_duration_s":53.429326,"scheduling_latency_s":53.429359,"gitaly_calls":13,"gitaly_duration_s":0.256724,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.045853,"redis_read_bytes":2108,"redis_write_bytes":21749,"redis_cache_calls":15,"redis_cache_duration_s":0.004107,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006673,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.00171,"redis_queues_read_bytes":15,"redis_queues_write_bytes":7837,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004254,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.018902,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.010207,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.125,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.168,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.189,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.125,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.502769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000789207,"exclusive_lock_hold_duration_s":0.050477645,"duration_s":0.955988,"completed_at":"2026-08-20T05:57:04.331Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.167476,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1991gitlab # [ 248.337354] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:04.403Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","887f27e7d697883edeccf41f10639c0a5316948f d3f019c6d0414710c10bcfe109e2734c66b33866 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"88c50d0cfc084d5ddfe09e2f","created_at":"2026-08-20T05:56:14.141Z","trace_propagation_headers":{"sentry-trace":"8cb4c1ea73ab4341a94512459897f7cf-f44f28afa5ec4ef4","baggage":"sentry-trace_id=8cb4c1ea73ab4341a94512459897f7cf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVKR7NRPFCST1Z8666QEE","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:14.147Z","job_size_bytes":185,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-88c50d0cfc084d5ddfe09e2f: start","job_status":"start","queue_duration_s":50.255843,"scheduling_latency_s":50.255878}1992gitlab # [ 248.370283] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:04.436Z","message":"changes: \"887f27e7d697883edeccf41f10639c0a5316948f d3f019c6d0414710c10bcfe109e2734c66b33866 refs/heads/master\\n\""}1993gitlab # [ 248.407289] gitaly[898]: time="2026-08-20T05:57:04.472Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:14.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:04.460" grpc.time_ms=12.227 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1994gitlab # [ 248.423215] gitaly[898]: time="2026-08-20T05:57:04.489Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:57:14.028" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:04.478" grpc.time_ms=10.315 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1995gitlab # [ 248.442397] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:04.508Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"2ae73d79d320a6f5067f5802","created_at":"2026-08-20T05:57:04.505Z","trace_propagation_headers":{"sentry-trace":"8cb4c1ea73ab4341a94512459897f7cf-cfc1ffbf0713430d","baggage":"sentry-trace_id=8cb4c1ea73ab4341a94512459897f7cf,sentry-release=Unknown"},"correlation_id":"01M0EVVKR7NRPFCST1Z8666QEE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"5a5e150247da887f3e16cb4c","job_size_bytes":46,"pid":2609,"job_status":"deduplicated","message":"ProjectCacheWorker JID-2ae73d79d320a6f5067f5802: deduplicated: until executing","deduplication.type":"until executing"}1996gitlab # [ 248.467149] gitaly[898]: time="2026-08-20T05:57:04.533Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T05:57:14.073" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:04.523" grpc.time_ms=9.401 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1997gitlab # [ 248.487784] gitaly[898]: time="2026-08-20T05:57:04.554Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-20T05:57:34.044" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:04.544" grpc.time_ms=9.172 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1998gitlab # [ 248.505536] gitaly[898]: time="2026-08-20T05:57:04.571Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T05:57:14.114" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T05:57:04.564" grpc.time_ms=7.083 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1999gitlab # [ 248.524798] gitaly[898]: time="2026-08-20T05:57:04.591Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:14.134" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:04.584" grpc.time_ms=6.669 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000gitlab # [ 248.628207] gitaly[898]: time="2026-08-20T05:57:04.694Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T05:57:14.242" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:04.692" grpc.time_ms=1.465 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2001gitlab # [ 248.654699] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:04.720Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","887f27e7d697883edeccf41f10639c0a5316948f d3f019c6d0414710c10bcfe109e2734c66b33866 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"88c50d0cfc084d5ddfe09e2f","created_at":"2026-08-20T05:56:14.141Z","trace_propagation_headers":{"sentry-trace":"8cb4c1ea73ab4341a94512459897f7cf-f44f28afa5ec4ef4","baggage":"sentry-trace_id=8cb4c1ea73ab4341a94512459897f7cf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVKR7NRPFCST1Z8666QEE","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:14.147Z","job_size_bytes":185,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-88c50d0cfc084d5ddfe09e2f: done: 0.316939 sec","job_status":"done","queue_duration_s":50.255843,"scheduling_latency_s":50.255878,"gitaly_calls":7,"gitaly_duration_s":0.107885,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.023571,"redis_read_bytes":501,"redis_write_bytes":11938,"redis_cache_calls":9,"redis_cache_duration_s":0.002624,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001328,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5715,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003546,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.009175,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.006898,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.022,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.022,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.159665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000927493,"exclusive_lock_hold_duration_s":0.024998987,"duration_s":0.316939,"completed_at":"2026-08-20T05:57:04.720Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028237,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2002gitlab # [ 248.664378] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:04.722Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"eef9f834314ffd10491d1550","created_at":"2026-08-20T05:56:14.309Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6a0c5cdc6da45fa","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:14.316Z","job_size_bytes":65,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-eef9f834314ffd10491d1550: start","job_status":"start","queue_duration_s":50.406237,"scheduling_latency_s":50.406268}2003gitlab # [ 248.720249] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:04.785Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"eef9f834314ffd10491d1550","created_at":"2026-08-20T05:56:14.309Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6a0c5cdc6da45fa","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:14.316Z","job_size_bytes":65,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-eef9f834314ffd10491d1550: done: 0.063314 sec","job_status":"done","queue_duration_s":50.406237,"scheduling_latency_s":50.406268,"redis_calls":16,"redis_duration_s":0.003878,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002013,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000465,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000292495,"duration_s":0.063314,"completed_at":"2026-08-20T05:57:04.785Z","load_balancing_strategy":"primary","db_duration_s":0.018845,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2004gitlab # [ 248.725439] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:04.787Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c3d8bc962f389879fca3a5f4","created_at":"2026-08-20T05:56:14.316Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6a0c5cdc6da45fa","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:14.319Z","job_size_bytes":65,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c3d8bc962f389879fca3a5f4: start","job_status":"start","queue_duration_s":50.468095,"scheduling_latency_s":50.468108}2005gitlab # [ 248.786516] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:04.852Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c3d8bc962f389879fca3a5f4","created_at":"2026-08-20T05:56:14.316Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6a0c5cdc6da45fa","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:14.319Z","job_size_bytes":65,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c3d8bc962f389879fca3a5f4: done: 0.064676 sec","job_status":"done","queue_duration_s":50.468095,"scheduling_latency_s":50.468108,"redis_calls":15,"redis_duration_s":0.0036810000000000002,"redis_read_bytes":142,"redis_write_bytes":1431,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000663,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":431,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001663,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001355,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000565994,"duration_s":0.064676,"completed_at":"2026-08-20T05:57:04.852Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019295,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2006gitlab # [ 248.788553] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:04.854Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f654bb8c8fd85b1fe6db884f","created_at":"2026-08-20T05:56:14.391Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6a0c5cdc6da45fa","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:14.395Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f654bb8c8fd85b1fe6db884f: start","job_status":"start","queue_duration_s":50.458827,"scheduling_latency_s":50.45886}2007gitlab # [ 248.960929] gitaly[898]: time="2026-08-20T05:57:05.027Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:05.024" grpc.time_ms=1.905 pid=898 span.kind=server system=grpc2008gitlab # [ 249.019497] gitaly[898]: time="2026-08-20T05:57:05.085Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:05.084" grpc.time_ms=0.751 pid=898 span.kind=server system=grpc2009gitlab # [ 249.073454] gitaly[898]: time="2026-08-20T05:57:05.139Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:05.137" grpc.time_ms=1.703 pid=898 span.kind=server system=grpc2010gitlab # [ 249.101440] gitaly[898]: time="2026-08-20T05:57:05.167Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 diskcache=3f444e35-4059-4080-b013-339c0a2b2f45 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:34.291" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:04.991" pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2011gitlab # [ 249.102264] gitaly[898]: time="2026-08-20T05:57:05.168Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=169 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7390 command.oublock=0 command.real_time_ms=165 command.spawn_token_fork_ms=0 command.system_time_ms=113 command.user_time_ms=56 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:34.291" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:04.991" grpc.time_ms=176.238 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2012gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'2013gitlab # [ 249.159785] nixbot[2614]: INFO: ::ffff:127.0.0.1:39898 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK2014gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)2015gitlab # [ 249.184071] gitaly[898]: time="2026-08-20T05:57:05.250Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:57:35.048" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:05.249" grpc.time_ms=1.064 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2016gitlab # [ 249.212174] gitaly[898]: time="2026-08-20T05:57:05.278Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:35.076" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:05.277" grpc.time_ms=0.809 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2017gitlab # [ 249.239679] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.305Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f654bb8c8fd85b1fe6db884f","created_at":"2026-08-20T05:56:14.391Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6a0c5cdc6da45fa","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:14.395Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2609,"job_status":"rescheduled","message":"PipelineProcessWorker JID-f654bb8c8fd85b1fe6db884f: rescheduled"}2018gitlab # [ 249.254118] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.318Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f654bb8c8fd85b1fe6db884f","created_at":"2026-08-20T05:56:14.391Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6a0c5cdc6da45fa","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:14.395Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f654bb8c8fd85b1fe6db884f: done: 0.463608 sec","job_status":"done","queue_duration_s":50.458827,"scheduling_latency_s":50.45886,"gitaly_calls":3,"gitaly_duration_s":0.184523,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.039001,"redis_read_bytes":463,"redis_write_bytes":29295,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001599,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001225,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.010342,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.004188,"redis_queues_read_bytes":40,"redis_queues_write_bytes":15582,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.005185,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000863,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000564,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.013436,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.018,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.021,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.18016,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.378907934,"duration_s":0.463608,"completed_at":"2026-08-20T05:57:05.318Z","load_balancing_strategy":"primary","db_duration_s":0.066448,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2019gitlab # [ 249.262749] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6dce11730c30cfb913375f9d","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6dce11730c30cfb913375f9d: start","job_status":"start","queue_duration_s":4.100257,"scheduling_latency_s":4.10029}2020gitlab # [ 249.346541] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6dce11730c30cfb913375f9d","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6dce11730c30cfb913375f9d: done: 0.091528 sec","job_status":"done","queue_duration_s":4.100257,"scheduling_latency_s":4.10029,"redis_calls":15,"redis_duration_s":0.004680999999999999,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000781,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001372,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002528,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.091528,"completed_at":"2026-08-20T05:57:05.411Z","load_balancing_strategy":"primary","db_duration_s":0.000921,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2021gitlab # [ 249.347758] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.413Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"349948e52aef9c824e7b43f8","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-349948e52aef9c824e7b43f8: start","job_status":"start","queue_duration_s":4.193954,"scheduling_latency_s":4.193994}2022gitlab # [ 249.368757] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"349948e52aef9c824e7b43f8","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-349948e52aef9c824e7b43f8: done: 0.02093 sec","job_status":"done","queue_duration_s":4.193954,"scheduling_latency_s":4.193994,"redis_calls":13,"redis_duration_s":0.003932,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001141,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002791,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02093,"completed_at":"2026-08-20T05:57:05.434Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2023gitlab # [ 249.387071] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c024796859387e2b3eecd12","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c024796859387e2b3eecd12: start","job_status":"start","queue_duration_s":4.216539,"scheduling_latency_s":4.216565}2024gitlab # [ 249.425779] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c024796859387e2b3eecd12","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c024796859387e2b3eecd12: done: 0.012787 sec","job_status":"done","queue_duration_s":4.216539,"scheduling_latency_s":4.216565,"redis_calls":13,"redis_duration_s":0.002456,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001685,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012787,"completed_at":"2026-08-20T05:57:05.449Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2025gitlab # [ 249.428102] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3d281916fd646bca58540fd","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3d281916fd646bca58540fd: start","job_status":"start","queue_duration_s":4.230736,"scheduling_latency_s":4.230749}2026gitlab # [ 249.438936] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3d281916fd646bca58540fd","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3d281916fd646bca58540fd: done: 0.01971 sec","job_status":"done","queue_duration_s":4.230736,"scheduling_latency_s":4.230749,"redis_calls":13,"redis_duration_s":0.002508,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001688,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01971,"completed_at":"2026-08-20T05:57:05.470Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2027gitlab # [ 249.472090] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5934a8acc09a0cec4f1d91e8","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5934a8acc09a0cec4f1d91e8: start","job_status":"start","queue_duration_s":4.252714,"scheduling_latency_s":4.252748}2028gitlab # [ 249.482634] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5934a8acc09a0cec4f1d91e8","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5934a8acc09a0cec4f1d91e8: done: 0.023729 sec","job_status":"done","queue_duration_s":4.252714,"scheduling_latency_s":4.252748,"redis_calls":13,"redis_duration_s":0.0036379999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001138,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023729,"completed_at":"2026-08-20T05:57:05.496Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2029gitlab # [ 249.533497] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.497Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dac71f08672511d14de7db74","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dac71f08672511d14de7db74: start","job_status":"start","queue_duration_s":4.278128,"scheduling_latency_s":4.278153}2030gitlab # [ 249.534237] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dac71f08672511d14de7db74","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dac71f08672511d14de7db74: done: 0.014475 sec","job_status":"done","queue_duration_s":4.278128,"scheduling_latency_s":4.278153,"redis_calls":13,"redis_duration_s":0.002709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001766,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014475,"completed_at":"2026-08-20T05:57:05.512Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2031gitlab # [ 249.589718] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f435d1f582a177d799c9959","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f435d1f582a177d799c9959: start","job_status":"start","queue_duration_s":4.293901,"scheduling_latency_s":4.293915}2032gitlab # [ 249.590532] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f435d1f582a177d799c9959","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f435d1f582a177d799c9959: done: 0.010482 sec","job_status":"done","queue_duration_s":4.293901,"scheduling_latency_s":4.293915,"redis_calls":13,"redis_duration_s":0.002634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000797,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001837,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010482,"completed_at":"2026-08-20T05:57:05.524Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2033gitlab # [ 249.632478] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43992d8b219bb569ae7409aa","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43992d8b219bb569ae7409aa: start","job_status":"start","queue_duration_s":4.305467,"scheduling_latency_s":4.30548}2034gitlab # [ 249.633035] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43992d8b219bb569ae7409aa","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43992d8b219bb569ae7409aa: done: 0.010917 sec","job_status":"done","queue_duration_s":4.305467,"scheduling_latency_s":4.30548,"redis_calls":13,"redis_duration_s":0.002536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000791,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001745,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010917,"completed_at":"2026-08-20T05:57:05.536Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2035gitlab # [ 249.673777] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e45cd7e1d11bdc495b15dbe","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e45cd7e1d11bdc495b15dbe: start","job_status":"start","queue_duration_s":4.317441,"scheduling_latency_s":4.317454}2036gitlab # [ 249.674620] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e45cd7e1d11bdc495b15dbe","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e45cd7e1d11bdc495b15dbe: done: 0.010832 sec","job_status":"done","queue_duration_s":4.317441,"scheduling_latency_s":4.317454,"redis_calls":13,"redis_duration_s":0.00261,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000798,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001812,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010832,"completed_at":"2026-08-20T05:57:05.548Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2037gitlab # [ 249.681669] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b44b9cda1631dc48fc433701","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b44b9cda1631dc48fc433701: start","job_status":"start","queue_duration_s":4.329327,"scheduling_latency_s":4.329341}2038gitlab # [ 249.719067] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b44b9cda1631dc48fc433701","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b44b9cda1631dc48fc433701: done: 0.01036 sec","job_status":"done","queue_duration_s":4.329327,"scheduling_latency_s":4.329341,"redis_calls":13,"redis_duration_s":0.002853,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00175,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01036,"completed_at":"2026-08-20T05:57:05.559Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2039gitlab # [ 249.722823] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fa27b16268e993ea8fb8df3","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fa27b16268e993ea8fb8df3: start","job_status":"start","queue_duration_s":4.341004,"scheduling_latency_s":4.341019}2040gitlab # [ 249.733820] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fa27b16268e993ea8fb8df3","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fa27b16268e993ea8fb8df3: done: 0.010332 sec","job_status":"done","queue_duration_s":4.341004,"scheduling_latency_s":4.341019,"redis_calls":13,"redis_duration_s":0.002495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001717,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005849,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010332,"completed_at":"2026-08-20T05:57:05.571Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2041gitlab # [ 249.766898] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da7c6acf7baf4542a52b93ac","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da7c6acf7baf4542a52b93ac: start","job_status":"start","queue_duration_s":4.352355,"scheduling_latency_s":4.352369}2042gitlab # [ 249.777213] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da7c6acf7baf4542a52b93ac","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da7c6acf7baf4542a52b93ac: done: 0.010291 sec","job_status":"done","queue_duration_s":4.352355,"scheduling_latency_s":4.352369,"redis_calls":13,"redis_duration_s":0.0025180000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001737,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010291,"completed_at":"2026-08-20T05:57:05.582Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2043gitlab # [ 249.823474] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6cec5423ca602bd026a1227","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6cec5423ca602bd026a1227: start","job_status":"start","queue_duration_s":4.363711,"scheduling_latency_s":4.363724}2044gitlab # [ 249.824369] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6cec5423ca602bd026a1227","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6cec5423ca602bd026a1227: done: 0.010135 sec","job_status":"done","queue_duration_s":4.363711,"scheduling_latency_s":4.363724,"redis_calls":13,"redis_duration_s":0.00244,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001637,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010135,"completed_at":"2026-08-20T05:57:05.593Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2045gitlab # [ 249.865655] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2f69ca856746ce51822fba0","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2f69ca856746ce51822fba0: start","job_status":"start","queue_duration_s":4.374913,"scheduling_latency_s":4.374927}2046gitlab # [ 249.866619] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2f69ca856746ce51822fba0","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2f69ca856746ce51822fba0: done: 0.010233 sec","job_status":"done","queue_duration_s":4.374913,"scheduling_latency_s":4.374927,"redis_calls":13,"redis_duration_s":0.0024140000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000791,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001623,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010233,"completed_at":"2026-08-20T05:57:05.604Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2047gitlab # [ 249.904264] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"906a5728c9bcec57712cd59e","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-906a5728c9bcec57712cd59e: start","job_status":"start","queue_duration_s":4.386492,"scheduling_latency_s":4.386506}2048gitlab # [ 249.905180] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"906a5728c9bcec57712cd59e","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-906a5728c9bcec57712cd59e: done: 0.010264 sec","job_status":"done","queue_duration_s":4.386492,"scheduling_latency_s":4.386506,"redis_calls":13,"redis_duration_s":0.0024029999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001622,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010264,"completed_at":"2026-08-20T05:57:05.616Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2049gitlab # [ 249.937504] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb1ba820d756ee6b8232d57f","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb1ba820d756ee6b8232d57f: start","job_status":"start","queue_duration_s":4.39781,"scheduling_latency_s":4.397822}2050gitlab # [ 249.980847] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb1ba820d756ee6b8232d57f","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb1ba820d756ee6b8232d57f: done: 0.012699 sec","job_status":"done","queue_duration_s":4.39781,"scheduling_latency_s":4.397822,"redis_calls":13,"redis_duration_s":0.003032,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002165,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006401,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012699,"completed_at":"2026-08-20T05:57:05.630Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2051gitlab # [ 249.982253] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9a8b5db319181d4ba04db34","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9a8b5db319181d4ba04db34: start","job_status":"start","queue_duration_s":4.411559,"scheduling_latency_s":4.411574}2052gitlab # [ 250.017077] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9a8b5db319181d4ba04db34","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9a8b5db319181d4ba04db34: done: 0.01026 sec","job_status":"done","queue_duration_s":4.411559,"scheduling_latency_s":4.411574,"redis_calls":13,"redis_duration_s":0.002435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000714,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001721,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01026,"completed_at":"2026-08-20T05:57:05.641Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2053gitlab # [ 250.052877] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65ffa0b20989dd4baf648670","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65ffa0b20989dd4baf648670: start","job_status":"start","queue_duration_s":4.422981,"scheduling_latency_s":4.422995}2054gitlab # [ 250.054520] gitaly[898]: time="2026-08-20T05:57:06.047Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-20T11:57:06.041" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:06.042" grpc.time_ms=5.033 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055gitlab # [ 250.055337] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65ffa0b20989dd4baf648670","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65ffa0b20989dd4baf648670: done: 0.010431 sec","job_status":"done","queue_duration_s":4.422981,"scheduling_latency_s":4.422995,"redis_calls":13,"redis_duration_s":0.002625,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00086,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001765,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010431,"completed_at":"2026-08-20T05:57:05.653Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2056gitlab # [ 250.071139] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"427a686302db6737e838d987","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-427a686302db6737e838d987: start","job_status":"start","queue_duration_s":4.434479,"scheduling_latency_s":4.434493}2057gitlab # [ 250.081949] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"427a686302db6737e838d987","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-427a686302db6737e838d987: done: 0.010413 sec","job_status":"done","queue_duration_s":4.434479,"scheduling_latency_s":4.434493,"redis_calls":13,"redis_duration_s":0.002465,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000746,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001719,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010413,"completed_at":"2026-08-20T05:57:05.664Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2058gitlab # [ 250.119237] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbc5c1f7b84b0da1d726d8bc","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbc5c1f7b84b0da1d726d8bc: start","job_status":"start","queue_duration_s":4.445915,"scheduling_latency_s":4.445929}2059gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'2060gitlab # [ 250.123157] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbc5c1f7b84b0da1d726d8bc","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbc5c1f7b84b0da1d726d8bc: done: 0.010516 sec","job_status":"done","queue_duration_s":4.445915,"scheduling_latency_s":4.445929,"redis_calls":13,"redis_duration_s":0.002424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001645,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010516,"completed_at":"2026-08-20T05:57:05.676Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2061gitlab # [ 250.180510] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75e3a1bc4609d19bbd9131f6","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75e3a1bc4609d19bbd9131f6: start","job_status":"start","queue_duration_s":4.457456,"scheduling_latency_s":4.457469}2062gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)2063gitlab # [ 250.181240] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75e3a1bc4609d19bbd9131f6","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75e3a1bc4609d19bbd9131f6: done: 0.011144 sec","job_status":"done","queue_duration_s":4.457456,"scheduling_latency_s":4.457469,"redis_calls":13,"redis_duration_s":0.002587,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001678,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011144,"completed_at":"2026-08-20T05:57:05.688Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2064gitlab # [ 250.218824] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53bc81411807e658cdf08f9f","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53bc81411807e658cdf08f9f: start","job_status":"start","queue_duration_s":4.469677,"scheduling_latency_s":4.46969}2065gitlab # [ 250.219757] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53bc81411807e658cdf08f9f","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53bc81411807e658cdf08f9f: done: 0.010701 sec","job_status":"done","queue_duration_s":4.469677,"scheduling_latency_s":4.46969,"redis_calls":13,"redis_duration_s":0.0025859999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000832,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001754,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010701,"completed_at":"2026-08-20T05:57:05.700Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2066gitlab # [ 250.238212] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f02eb4d0f55a187f717bf2c4","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f02eb4d0f55a187f717bf2c4: start","job_status":"start","queue_duration_s":4.481415,"scheduling_latency_s":4.481428}2067gitlab # [ 250.273370] nixbot[2614]: INFO: ::ffff:127.0.0.1:39914 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK2068gitlab # [ 250.274161] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f02eb4d0f55a187f717bf2c4","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f02eb4d0f55a187f717bf2c4: done: 0.01011 sec","job_status":"done","queue_duration_s":4.481415,"scheduling_latency_s":4.481428,"redis_calls":13,"redis_duration_s":0.002206,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001549,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01011,"completed_at":"2026-08-20T05:57:05.711Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2069gitlab # [ 250.312726] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee3ee0d421a9776001cc30e3","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee3ee0d421a9776001cc30e3: start","job_status":"start","queue_duration_s":4.492565,"scheduling_latency_s":4.492579}2070gitlab # [ 250.313596] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee3ee0d421a9776001cc30e3","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee3ee0d421a9776001cc30e3: done: 0.009082 sec","job_status":"done","queue_duration_s":4.492565,"scheduling_latency_s":4.492579,"redis_calls":13,"redis_duration_s":0.0016350000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009082,"completed_at":"2026-08-20T05:57:05.721Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2071gitlab # [ 250.349743] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1005a3fddc155227aedbf134","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1005a3fddc155227aedbf134: start","job_status":"start","queue_duration_s":4.502479,"scheduling_latency_s":4.502492}2072gitlab # [ 250.350570] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1005a3fddc155227aedbf134","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1005a3fddc155227aedbf134: done: 0.00944 sec","job_status":"done","queue_duration_s":4.502479,"scheduling_latency_s":4.502492,"redis_calls":13,"redis_duration_s":0.00165,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001159,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00944,"completed_at":"2026-08-20T05:57:05.731Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2073gitlab # [ 250.387777] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"017973e1c479978601e70787","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-017973e1c479978601e70787: start","job_status":"start","queue_duration_s":4.512738,"scheduling_latency_s":4.512752}2074gitlab # [ 250.388661] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"017973e1c479978601e70787","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-017973e1c479978601e70787: done: 0.009252 sec","job_status":"done","queue_duration_s":4.512738,"scheduling_latency_s":4.512752,"redis_calls":13,"redis_duration_s":0.001715,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000615,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009252,"completed_at":"2026-08-20T05:57:05.741Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2075gitlab # [ 250.404265] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4649accab0b4df0a812bb93","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4649accab0b4df0a812bb93: start","job_status":"start","queue_duration_s":4.52308,"scheduling_latency_s":4.523093}2076gitlab # [ 250.414962] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4649accab0b4df0a812bb93","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4649accab0b4df0a812bb93: done: 0.010565 sec","job_status":"done","queue_duration_s":4.52308,"scheduling_latency_s":4.523093,"redis_calls":13,"redis_duration_s":0.002546,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000795,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001751,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010565,"completed_at":"2026-08-20T05:57:05.753Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2077gitlab # [ 250.453936] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.754Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42ad320d10168814aea62d71","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42ad320d10168814aea62d71: start","job_status":"start","queue_duration_s":4.534733,"scheduling_latency_s":4.534747}2078gitlab # [ 250.488822] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42ad320d10168814aea62d71","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42ad320d10168814aea62d71: done: 0.011404 sec","job_status":"done","queue_duration_s":4.534733,"scheduling_latency_s":4.534747,"redis_calls":13,"redis_duration_s":0.0016549999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011404,"completed_at":"2026-08-20T05:57:05.765Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2079gitlab # [ 250.489970] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54d59d56bfe50540cf3aa291","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54d59d56bfe50540cf3aa291: start","job_status":"start","queue_duration_s":4.547986,"scheduling_latency_s":4.548008}2080gitlab # [ 250.497278] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54d59d56bfe50540cf3aa291","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54d59d56bfe50540cf3aa291: done: 0.011688 sec","job_status":"done","queue_duration_s":4.547986,"scheduling_latency_s":4.548008,"redis_calls":13,"redis_duration_s":0.002627,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001811,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011688,"completed_at":"2026-08-20T05:57:05.779Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2081gitlab # [ 250.530551] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecf3718f646f59cf12c14580","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecf3718f646f59cf12c14580: start","job_status":"start","queue_duration_s":4.560743,"scheduling_latency_s":4.560756}2082gitlab # [ 250.566849] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecf3718f646f59cf12c14580","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecf3718f646f59cf12c14580: done: 0.009586 sec","job_status":"done","queue_duration_s":4.560743,"scheduling_latency_s":4.560756,"redis_calls":13,"redis_duration_s":0.001808,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000665,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009586,"completed_at":"2026-08-20T05:57:05.790Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2083gitlab # [ 250.570899] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73e0e791c45b226299870042","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73e0e791c45b226299870042: start","job_status":"start","queue_duration_s":4.571135,"scheduling_latency_s":4.571147}2084gitlab # [ 250.581051] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73e0e791c45b226299870042","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73e0e791c45b226299870042: done: 0.009148 sec","job_status":"done","queue_duration_s":4.571135,"scheduling_latency_s":4.571147,"redis_calls":13,"redis_duration_s":0.0016129999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009148,"completed_at":"2026-08-20T05:57:05.800Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2085gitlab # [ 250.631614] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9beaaab90f4ed8b8491f08d","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9beaaab90f4ed8b8491f08d: start","job_status":"start","queue_duration_s":4.581302,"scheduling_latency_s":4.581315}2086gitlab # [ 250.632462] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9beaaab90f4ed8b8491f08d","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9beaaab90f4ed8b8491f08d: done: 0.008929 sec","job_status":"done","queue_duration_s":4.581302,"scheduling_latency_s":4.581315,"redis_calls":13,"redis_duration_s":0.001516,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008929,"completed_at":"2026-08-20T05:57:05.809Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2087gitlab # [ 250.653635] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02cd67cf32ccccc3cda1f524","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02cd67cf32ccccc3cda1f524: start","job_status":"start","queue_duration_s":4.591056,"scheduling_latency_s":4.59107}2088gitlab # [ 250.663728] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02cd67cf32ccccc3cda1f524","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02cd67cf32ccccc3cda1f524: done: 0.008913 sec","job_status":"done","queue_duration_s":4.591056,"scheduling_latency_s":4.59107,"redis_calls":13,"redis_duration_s":0.001557,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008913,"completed_at":"2026-08-20T05:57:05.819Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2089gitlab # [ 250.706615] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"327e546eb0400ba80c1e0b3b","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-327e546eb0400ba80c1e0b3b: start","job_status":"start","queue_duration_s":4.600794,"scheduling_latency_s":4.600807}2090gitlab # [ 250.707191] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"327e546eb0400ba80c1e0b3b","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-327e546eb0400ba80c1e0b3b: done: 0.009222 sec","job_status":"done","queue_duration_s":4.600794,"scheduling_latency_s":4.600807,"redis_calls":13,"redis_duration_s":0.001735,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000689,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009222,"completed_at":"2026-08-20T05:57:05.829Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2091gitlab # [ 250.753098] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"070eb6176c14ed4e48df5021","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-070eb6176c14ed4e48df5021: start","job_status":"start","queue_duration_s":4.610868,"scheduling_latency_s":4.610881}2092gitlab # [ 250.753802] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"070eb6176c14ed4e48df5021","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-070eb6176c14ed4e48df5021: done: 0.008871 sec","job_status":"done","queue_duration_s":4.610868,"scheduling_latency_s":4.610881,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008871,"completed_at":"2026-08-20T05:57:05.839Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2093gitlab # [ 250.791758] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f401206670e2cec17fe51935","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f401206670e2cec17fe51935: start","job_status":"start","queue_duration_s":4.620536,"scheduling_latency_s":4.620549}2094gitlab # [ 250.792378] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f401206670e2cec17fe51935","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f401206670e2cec17fe51935: done: 0.009438 sec","job_status":"done","queue_duration_s":4.620536,"scheduling_latency_s":4.620549,"redis_calls":13,"redis_duration_s":0.001774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009438,"completed_at":"2026-08-20T05:57:05.849Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2095gitlab # [ 250.835149] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21cac57db794ff8e10af4619","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21cac57db794ff8e10af4619: start","job_status":"start","queue_duration_s":4.630972,"scheduling_latency_s":4.630986}2096gitlab # [ 250.835881] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21cac57db794ff8e10af4619","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21cac57db794ff8e10af4619: done: 0.009761 sec","job_status":"done","queue_duration_s":4.630972,"scheduling_latency_s":4.630986,"redis_calls":13,"redis_duration_s":0.002173,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001477,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009761,"completed_at":"2026-08-20T05:57:05.860Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2097gitlab # [ 250.859572] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd9cc809e03cbe4ee674fe3f","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd9cc809e03cbe4ee674fe3f: start","job_status":"start","queue_duration_s":4.641722,"scheduling_latency_s":4.641735}2098gitlab # [ 250.894559] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd9cc809e03cbe4ee674fe3f","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd9cc809e03cbe4ee674fe3f: done: 0.014381 sec","job_status":"done","queue_duration_s":4.641722,"scheduling_latency_s":4.641735,"redis_calls":13,"redis_duration_s":0.002282,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00156,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014381,"completed_at":"2026-08-20T05:57:05.875Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2099gitlab # [ 250.929265] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51b753c54c5ee281cc0bf75e","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51b753c54c5ee281cc0bf75e: start","job_status":"start","queue_duration_s":4.65709,"scheduling_latency_s":4.657102}2100gitlab # [ 250.929931] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51b753c54c5ee281cc0bf75e","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51b753c54c5ee281cc0bf75e: done: 0.009549 sec","job_status":"done","queue_duration_s":4.65709,"scheduling_latency_s":4.657102,"redis_calls":13,"redis_duration_s":0.00224,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000704,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001536,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009549,"completed_at":"2026-08-20T05:57:05.886Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2101gitlab # [ 250.973157] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d1ce707c5cea56b083271e2","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d1ce707c5cea56b083271e2: start","job_status":"start","queue_duration_s":4.667724,"scheduling_latency_s":4.667737}2102gitlab # [ 250.973838] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d1ce707c5cea56b083271e2","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d1ce707c5cea56b083271e2: done: 0.010032 sec","job_status":"done","queue_duration_s":4.667724,"scheduling_latency_s":4.667737,"redis_calls":13,"redis_duration_s":0.00255,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001743,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010032,"completed_at":"2026-08-20T05:57:05.897Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2103gitlab # [ 251.012538] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0956f51c3da90c20bf89eb92","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0956f51c3da90c20bf89eb92: start","job_status":"start","queue_duration_s":4.678822,"scheduling_latency_s":4.678836}2104gitlab # [ 251.013175] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0956f51c3da90c20bf89eb92","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0956f51c3da90c20bf89eb92: done: 0.009953 sec","job_status":"done","queue_duration_s":4.678822,"scheduling_latency_s":4.678836,"redis_calls":13,"redis_duration_s":0.002512,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001761,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009953,"completed_at":"2026-08-20T05:57:05.908Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2105gitlab # [ 251.049239] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31a0e799e78ce8b9079a4312","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31a0e799e78ce8b9079a4312: start","job_status":"start","queue_duration_s":4.68986,"scheduling_latency_s":4.689873}2106gitlab # [ 251.049809] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31a0e799e78ce8b9079a4312","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31a0e799e78ce8b9079a4312: done: 0.009983 sec","job_status":"done","queue_duration_s":4.68986,"scheduling_latency_s":4.689873,"redis_calls":13,"redis_duration_s":0.002489,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001711,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009983,"completed_at":"2026-08-20T05:57:05.919Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2107gitlab # [ 251.089516] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b7add54726615c4914145fc","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b7add54726615c4914145fc: start","job_status":"start","queue_duration_s":4.700905,"scheduling_latency_s":4.700918}2108gitlab # [ 251.090221] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b7add54726615c4914145fc","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b7add54726615c4914145fc: done: 0.010404 sec","job_status":"done","queue_duration_s":4.700905,"scheduling_latency_s":4.700918,"redis_calls":13,"redis_duration_s":0.002823,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010404,"completed_at":"2026-08-20T05:57:05.931Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2109gitlab # [ 251.102969] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.932Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c29aa3719ffb66a52fcf1fb","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c29aa3719ffb66a52fcf1fb: start","job_status":"start","queue_duration_s":4.71237,"scheduling_latency_s":4.712384}2110gitlab # [ 251.144895] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c29aa3719ffb66a52fcf1fb","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c29aa3719ffb66a52fcf1fb: done: 0.010147 sec","job_status":"done","queue_duration_s":4.71237,"scheduling_latency_s":4.712384,"redis_calls":13,"redis_duration_s":0.002571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001741,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010147,"completed_at":"2026-08-20T05:57:05.942Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2111gitlab # [ 251.145840] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c5171c06ee45577afe41b12","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c5171c06ee45577afe41b12: start","job_status":"start","queue_duration_s":4.723586,"scheduling_latency_s":4.723601}2112gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'2113gitlab # [ 251.180424] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c5171c06ee45577afe41b12","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c5171c06ee45577afe41b12: done: 0.010113 sec","job_status":"done","queue_duration_s":4.723586,"scheduling_latency_s":4.723601,"redis_calls":13,"redis_duration_s":0.002545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000814,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001731,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010113,"completed_at":"2026-08-20T05:57:05.953Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2114gitlab # [ 251.215931] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c1e68336f2feb7c25f61f22","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c1e68336f2feb7c25f61f22: start","job_status":"start","queue_duration_s":4.734798,"scheduling_latency_s":4.73481}2115gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)2116gitlab # [ 251.216632] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c1e68336f2feb7c25f61f22","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c1e68336f2feb7c25f61f22: done: 0.009985 sec","job_status":"done","queue_duration_s":4.734798,"scheduling_latency_s":4.73481,"redis_calls":13,"redis_duration_s":0.002558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000799,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001759,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009985,"completed_at":"2026-08-20T05:57:05.964Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2117gitlab # [ 251.224581] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f5315c3868669ea98dc0545","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f5315c3868669ea98dc0545: start","job_status":"start","queue_duration_s":4.74588,"scheduling_latency_s":4.745893}2118gitlab # [ 251.263219] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f5315c3868669ea98dc0545","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f5315c3868669ea98dc0545: done: 0.00998 sec","job_status":"done","queue_duration_s":4.74588,"scheduling_latency_s":4.745893,"redis_calls":13,"redis_duration_s":0.002541,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000784,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001757,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00998,"completed_at":"2026-08-20T05:57:05.975Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2119gitlab # [ 251.264578] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3d6732fafd448bfd3ca887a","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3d6732fafd448bfd3ca887a: start","job_status":"start","queue_duration_s":4.756923,"scheduling_latency_s":4.756936}2120gitlab # [ 251.306237] nixbot[2614]: INFO: ::ffff:127.0.0.1:39916 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK2121gitlab # [ 251.306917] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3d6732fafd448bfd3ca887a","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3d6732fafd448bfd3ca887a: done: 0.009968 sec","job_status":"done","queue_duration_s":4.756923,"scheduling_latency_s":4.756936,"redis_calls":13,"redis_duration_s":0.002456,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001651,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009968,"completed_at":"2026-08-20T05:57:05.986Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2122gitlab # [ 251.307732] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bac42c8cf474c42ef6bcb0c","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bac42c8cf474c42ef6bcb0c: start","job_status":"start","queue_duration_s":4.767947,"scheduling_latency_s":4.767961}2123gitlab # [ 251.316924] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bac42c8cf474c42ef6bcb0c","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bac42c8cf474c42ef6bcb0c: done: 0.009882 sec","job_status":"done","queue_duration_s":4.767947,"scheduling_latency_s":4.767961,"redis_calls":13,"redis_duration_s":0.0025499999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001749,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009882,"completed_at":"2026-08-20T05:57:05.997Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2124gitlab # [ 251.357929] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:05.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"561bd311d4f9e8efb6951097","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-561bd311d4f9e8efb6951097: start","job_status":"start","queue_duration_s":4.778931,"scheduling_latency_s":4.778945}2125gitlab # [ 251.358629] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:06.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"561bd311d4f9e8efb6951097","created_at":"2026-08-20T05:57:01.161Z","trace_propagation_headers":{"sentry-trace":"3878fb870ac449aaa0fe41b065555c0b-e3eaeffe08b24b89","baggage":"sentry-trace_id=3878fb870ac449aaa0fe41b065555c0b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"daeca41b6176083bd9fc453b7bcd92ba","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:01.219Z","job_size_bytes":2,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-561bd311d4f9e8efb6951097: done: 0.010095 sec","job_status":"done","queue_duration_s":4.778931,"scheduling_latency_s":4.778945,"redis_calls":13,"redis_duration_s":0.002731,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001776,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010095,"completed_at":"2026-08-20T05:57:06.008Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2126gitlab # [ 251.406408] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:06.009Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"5a5e150247da887f3e16cb4c","created_at":"2026-08-20T05:57:03.479Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-adbe4aaddc724e98","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:03.485Z","job_size_bytes":46,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-5a5e150247da887f3e16cb4c: start","job_status":"start","queue_duration_s":2.524317,"scheduling_latency_s":2.524331}2127gitlab # [ 251.444795] gitaly[898]: time="2026-08-20T05:57:07.510Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=655 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T05:57:37.303" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:07.503" grpc.time_ms=6.85 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2128gitlab # [ 251.463391] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:07.529Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"5a5e150247da887f3e16cb4c","created_at":"2026-08-20T05:57:03.479Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-adbe4aaddc724e98","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:03.485Z","job_size_bytes":46,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-5a5e150247da887f3e16cb4c: done: 1.519408 sec","job_status":"done","queue_duration_s":2.524317,"scheduling_latency_s":2.524331,"gitaly_calls":2,"gitaly_duration_s":1.465316,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.005279,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.000777,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000385,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001064,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002248,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000805,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000235226,"duration_s":1.519408,"completed_at":"2026-08-20T05:57:07.529Z","load_balancing_strategy":"primary","db_duration_s":0.01139,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2129gitlab # [ 251.466752] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:07.530Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"d85840d9bc5e55a5447589c7","created_at":"2026-08-20T05:57:03.500Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-adbe4aaddc724e98","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:03.505Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-d85840d9bc5e55a5447589c7: start","job_status":"start","queue_duration_s":4.024752,"scheduling_latency_s":4.024767}2130gitlab # [ 251.523710] gitaly[898]: time="2026-08-20T05:57:07.589Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 diskcache=478f13c9-a3c9-4407-a4ed-93758bccc7be grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:57:07.544" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:07.544" pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2131gitlab # [ 251.524419] gitaly[898]: time="2026-08-20T05:57:07.590Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1284 command.oublock=0 command.real_time_ms=45 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:57:07.544" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:07.544" grpc.time_ms=45.481 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2132gitlab # [ 251.553930] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:07.619Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"d85840d9bc5e55a5447589c7","created_at":"2026-08-20T05:57:03.500Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-adbe4aaddc724e98","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:03.505Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-d85840d9bc5e55a5447589c7: done: 0.08952 sec","job_status":"done","queue_duration_s":4.024752,"scheduling_latency_s":4.024767,"gitaly_calls":1,"gitaly_duration_s":0.047269,"redis_calls":15,"redis_duration_s":0.002572,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001039,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000352,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07458266399999999,"duration_s":0.08952,"completed_at":"2026-08-20T05:57:07.619Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013106,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2133gitlab # [ 251.590960] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:07.657Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"4d55115367494872ecef320b","created_at":"2026-08-20T05:57:03.654Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-adbe4aaddc724e98","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:03.657Z","job_size_bytes":23,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-4d55115367494872ecef320b: start","job_status":"start","queue_duration_s":3.999981,"scheduling_latency_s":4.000005}2134gitlab # [ 251.636687] gitaly[898]: time="2026-08-20T05:57:07.702Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T05:57:37.490" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:07.690" grpc.time_ms=11.886 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2135gitlab # [ 251.653395] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:07.719Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"4d55115367494872ecef320b","created_at":"2026-08-20T05:57:03.654Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-adbe4aaddc724e98","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:03.657Z","job_size_bytes":23,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-4d55115367494872ecef320b: done: 0.06236 sec","job_status":"done","queue_duration_s":3.999981,"scheduling_latency_s":4.000005,"gitaly_calls":1,"gitaly_duration_s":0.014546,"redis_calls":16,"redis_duration_s":0.012986000000000001,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000189,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.011204,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000679,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.06236,"completed_at":"2026-08-20T05:57:07.719Z","load_balancing_strategy":"primary","db_duration_s":0.009016,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2136gitlab # [ 251.689159] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:07.755Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c35e4556bca8532e5481eda8","created_at":"2026-08-20T05:57:04.133Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-adbe4aaddc724e98","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8fe0ec3e0854a2dbd11c2bc6c2d35c60084e977953694ed8f14009e282d8af80","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:04.138Z","job_size_bytes":467,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c35e4556bca8532e5481eda8: start","job_status":"start","queue_duration_s":3.616241,"scheduling_latency_s":3.616269}2137gitlab # [ 251.711539] gitaly[898]: time="2026-08-20T05:57:07.777Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:37.576" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:07.776" grpc.time_ms=0.755 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab # [ 251.722355] gitaly[898]: time="2026-08-20T05:57:07.788Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:57:17.009" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:07.780" grpc.time_ms=8.353 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2139gitlab # [ 251.860333] gitaly[898]: time="2026-08-20T05:57:07.926Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:57:37.724" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:07.925" grpc.time_ms=1.238 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2140gitlab # [ 251.887872] gitaly[898]: time="2026-08-20T05:57:07.953Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=139 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T05:57:37.750" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:07.950" grpc.time_ms=2.905 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2141gitlab # [ 251.956183] gitaly[898]: time="2026-08-20T05:57:08.022Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:18.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:08.010" grpc.time_ms=11.615 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2142gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'2143gitlab # [ 252.295606] nixbot[2614]: INFO: ::ffff:127.0.0.1:39932 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK2144gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.05 seconds)2145gitlab # [ 252.427504] gitaly[898]: time="2026-08-20T05:57:08.493Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T05:57:38.275" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:08.475" grpc.time_ms=17.82 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2146gitlab # [ 252.445256] gitaly[898]: time="2026-08-20T05:57:08.511Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVFJQY0MYHNYHZVK8JRH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T05:57:38.296" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:08.497" grpc.time_ms=13.79 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2147gitlab # [ 252.478325] sidekiq-cluster[2609]: {"severity":"WARN","time":"2026-08-20T05:57:08.544Z","class":"CreatePipelineWorker","correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"887f27e7d697883edeccf41f10639c0a5316948f","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"887f27e7d697883edeccf41f10639c0a5316948f","ref":"refs/heads/master"},"retry":0}2148gitlab # [ 252.487385] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:08.553Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c35e4556bca8532e5481eda8","created_at":"2026-08-20T05:57:04.133Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-adbe4aaddc724e98","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8fe0ec3e0854a2dbd11c2bc6c2d35c60084e977953694ed8f14009e282d8af80","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:04.138Z","job_size_bytes":467,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c35e4556bca8532e5481eda8: done: 0.798044 sec","job_status":"done","queue_duration_s":3.616241,"scheduling_latency_s":3.616269,"gitaly_calls":7,"gitaly_duration_s":0.12375,"redis_calls":51,"redis_duration_s":0.01119,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000922,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.004952,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001499,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002558,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001259,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.606893,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000461232,"duration_s":0.798044,"completed_at":"2026-08-20T05:57:08.553Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.053499,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2149gitlab # [ 252.491200] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:08.555Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"8c0b1b42-d94d-4c46-8277-df586879c588\"}"],"class":"WebHookWorker","jid":"b9487bcce5e3bcf5699d41d1","created_at":"2026-08-20T05:57:04.250Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-adbe4aaddc724e98","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da985ef90d2cf30dcf9a34fe6b18f200233d124c773d0ad9d765d94c04c6f730","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:04.255Z","job_size_bytes":1751,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-b9487bcce5e3bcf5699d41d1: start","job_status":"start","queue_duration_s":4.299896,"scheduling_latency_s":4.299921}2150gitlab # [ 252.583680] nixbot[2614]: INFO: ::ffff:127.0.0.1:39948 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2151gitlab # [ 252.596517] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:08.662Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"8c0b1b42-d94d-4c46-8277-df586879c588\"}"],"class":"WebHookWorker","jid":"b9487bcce5e3bcf5699d41d1","created_at":"2026-08-20T05:57:04.250Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-adbe4aaddc724e98","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da985ef90d2cf30dcf9a34fe6b18f200233d124c773d0ad9d765d94c04c6f730","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:04.255Z","job_size_bytes":1751,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-b9487bcce5e3bcf5699d41d1: done: 0.107313 sec","job_status":"done","queue_duration_s":4.299896,"scheduling_latency_s":4.299921,"redis_calls":19,"redis_duration_s":0.0044080000000000005,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001067,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.00042,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00203,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.03000939999998309,"cpu_s":0.063842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000208685,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.107313,"completed_at":"2026-08-20T05:57:08.662Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2152gitlab # [ 252.636656] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:08.702Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"d69c759ec601a01911f100a4","created_at":"2026-08-20T05:57:04.515Z","trace_propagation_headers":{"sentry-trace":"8cb4c1ea73ab4341a94512459897f7cf-cfc1ffbf0713430d","baggage":"sentry-trace_id=8cb4c1ea73ab4341a94512459897f7cf,sentry-release=Unknown"},"correlation_id":"01M0EVVKR7NRPFCST1Z8666QEE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"d85840d9bc5e55a5447589c7","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:04.518Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-d69c759ec601a01911f100a4: start","job_status":"start","queue_duration_s":4.184369,"scheduling_latency_s":4.184394}2153gitlab # [ 252.664319] gitaly[898]: time="2026-08-20T05:57:08.730Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE diskcache=66b6fba6-aca9-4b5b-99f2-cc974a56a761 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:57:08.719" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:08.720" pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2154gitlab # [ 252.664514] gitaly[898]: time="2026-08-20T05:57:08.730Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=311 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:57:08.719" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:08.720" grpc.time_ms=10.081 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2155gitlab # [ 252.688789] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:08.754Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"d69c759ec601a01911f100a4","created_at":"2026-08-20T05:57:04.515Z","trace_propagation_headers":{"sentry-trace":"8cb4c1ea73ab4341a94512459897f7cf-cfc1ffbf0713430d","baggage":"sentry-trace_id=8cb4c1ea73ab4341a94512459897f7cf,sentry-release=Unknown"},"correlation_id":"01M0EVVKR7NRPFCST1Z8666QEE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"d85840d9bc5e55a5447589c7","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:04.518Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-d69c759ec601a01911f100a4: done: 0.052069 sec","job_status":"done","queue_duration_s":4.184369,"scheduling_latency_s":4.184394,"gitaly_calls":1,"gitaly_duration_s":0.012641,"redis_calls":12,"redis_duration_s":0.014514,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002206,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000483,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.011825,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.025989336,"duration_s":0.052069,"completed_at":"2026-08-20T05:57:08.754Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007551,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2156gitlab # [ 252.727001] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:08.792Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"568f2ee94581a5780b20cf2b","created_at":"2026-08-20T05:57:04.650Z","trace_propagation_headers":{"sentry-trace":"8cb4c1ea73ab4341a94512459897f7cf-cfc1ffbf0713430d","baggage":"sentry-trace_id=8cb4c1ea73ab4341a94512459897f7cf,sentry-release=Unknown"},"correlation_id":"01M0EVVKR7NRPFCST1Z8666QEE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:186870e8c117038cee870193c515efac763275b89f454b01d9292602cae6848b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:04.653Z","job_size_bytes":467,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-568f2ee94581a5780b20cf2b: start","job_status":"start","queue_duration_s":4.139242,"scheduling_latency_s":4.139284}2157gitlab # [ 252.751735] gitaly[898]: time="2026-08-20T05:57:08.817Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=7 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVX9E5BP7NQZPEZFHJPA63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:08.800" grpc.time_ms=17.517 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc2158gitlab # [ 252.762976] gitaly[898]: time="2026-08-20T05:57:08.828Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:38.626" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:08.827" grpc.time_ms=1.054 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2159gitlab # [ 252.764108] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1442160gitlab # [ 252.769633] gitaly[898]: time="2026-08-20T05:57:08.835Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:57:18.059" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:08.830" grpc.time_ms=5.547 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2161gitlab # [ 252.798417] gitaly[898]: time="2026-08-20T05:57:08.864Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:57:38.663" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:08.864" grpc.time_ms=0.586 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2162gitlab # [ 252.814356] gitaly[898]: time="2026-08-20T05:57:08.880Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=50 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T05:57:38.678" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:08.878" grpc.time_ms=1.643 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2163gitlab # [ 252.828713] gitaly[898]: time="2026-08-20T05:57:08.894Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVX9JQ7109SYJBFF3FJGWH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:08.888" pid=898 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2164gitlab # [ 252.837916] gitaly[898]: time="2026-08-20T05:57:08.895Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVX9JQ7109SYJBFF3FJGWH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:08.888" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc2165gitlab # [ 252.849731] gitlab-workhorse[822]: time="2026-08-20T05:57:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672166gitlab # [ 252.851527] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 712167gitlab # [ 252.853353] gitaly[898]: time="2026-08-20T05:57:08.895Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVX9JQ7109SYJBFF3FJGWH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:08.888" grpc.time_ms=7.028 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc2168gitlab # [ 252.866202] nixbot[2614]: {"ts": "2026-08-20T05:57:08.918Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2169gitlab # [ 252.868559] gitaly[898]: time="2026-08-20T05:57:08.914Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:18.139" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:08.910" grpc.time_ms=4.611 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2170gitlab # [ 252.900578] gitaly[898]: time="2026-08-20T05:57:08.966Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVX9NY8MKQ1V21TZMKMGG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:38.265" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:08.966" grpc.time_ms=0.515 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2171gitlab # [ 252.940540] gitaly[898]: time="2026-08-20T05:57:09.006Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVX9NY8MKQ1V21TZMKMGG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:19.000" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:09.000" grpc.time_ms=5.79 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2172gitlab # [ 252.972304] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/887f27e7d697883edeccf41f10639c0a5316948f HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1112173gitlab # [ 252.975637] nixbot[2614]: {"ts": "2026-08-20T05:57:09.041Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/887f27e7d697883edeccf41f10639c0a5316948f \"HTTP/1.1 201 Created\""}2174gitlab # [ 253.020757] gitaly[898]: time="2026-08-20T05:57:09.086Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVX9SPZN9QEF74WMCJZ32C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:39.084" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:09.085" grpc.time_ms=0.742 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2175gitlab # [ 253.076370] gitaly[898]: time="2026-08-20T05:57:09.142Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVX9SPZN9QEF74WMCJZ32C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:19.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:09.135" grpc.time_ms=6.449 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2176gitlab # [ 253.153684] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/887f27e7d697883edeccf41f10639c0a5316948f HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1722177gitlab # [ 253.154670] nixbot[2614]: {"ts": "2026-08-20T05:57:09.220Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/887f27e7d697883edeccf41f10639c0a5316948f \"HTTP/1.1 201 Created\""}2178gitlab # [ 253.208053] gitaly[898]: time="2026-08-20T05:57:09.274Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVX9ZC5FQSKZ8N8E5S64N9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:39.272" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:09.273" grpc.time_ms=0.897 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2179gitlab # [ 253.280870] gitaly[898]: time="2026-08-20T05:57:09.347Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T05:57:39.132" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:09.332" grpc.time_ms=14.44 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2180gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'2181gitlab # [ 253.287927] gitaly[898]: time="2026-08-20T05:57:09.354Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVX9ZC5FQSKZ8N8E5S64N9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:19.033" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:09.343" grpc.time_ms=10.142 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2182gitlab # [ 253.292118] gitaly[898]: time="2026-08-20T05:57:09.357Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVKR7NRPFCST1Z8666QEE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T05:57:39.149" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:09.349" grpc.time_ms=7.59 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2183gitlab # [ 253.303111] sidekiq-cluster[2609]: {"severity":"WARN","time":"2026-08-20T05:57:09.368Z","class":"CreatePipelineWorker","correlation_id":"01M0EVVKR7NRPFCST1Z8666QEE","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"887f27e7d697883edeccf41f10639c0a5316948f","after":"d3f019c6d0414710c10bcfe109e2734c66b33866","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"d3f019c6d0414710c10bcfe109e2734c66b33866","ref":"refs/heads/master"},"retry":0}2184gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 0.04 seconds)2185gitlab # [ 253.309803] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.375Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"568f2ee94581a5780b20cf2b","created_at":"2026-08-20T05:57:04.650Z","trace_propagation_headers":{"sentry-trace":"8cb4c1ea73ab4341a94512459897f7cf-cfc1ffbf0713430d","baggage":"sentry-trace_id=8cb4c1ea73ab4341a94512459897f7cf,sentry-release=Unknown"},"correlation_id":"01M0EVVKR7NRPFCST1Z8666QEE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:186870e8c117038cee870193c515efac763275b89f454b01d9292602cae6848b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:04.653Z","job_size_bytes":467,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-568f2ee94581a5780b20cf2b: done: 0.582976 sec","job_status":"done","queue_duration_s":4.139242,"scheduling_latency_s":4.139284,"gitaly_calls":7,"gitaly_duration_s":0.091041,"redis_calls":33,"redis_duration_s":0.007144,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000373,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002052,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003001,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001718,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.471126,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.582976,"completed_at":"2026-08-20T05:57:09.375Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022081,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2186gitlab # [ 253.359758] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.381Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"e2b41535-111f-40cb-a930-45754663d4d7\"}"],"class":"WebHookWorker","jid":"cb3a854c7d440ddeb0180659","created_at":"2026-08-20T05:57:04.674Z","trace_propagation_headers":{"sentry-trace":"8cb4c1ea73ab4341a94512459897f7cf-cfc1ffbf0713430d","baggage":"sentry-trace_id=8cb4c1ea73ab4341a94512459897f7cf,sentry-release=Unknown"},"correlation_id":"01M0EVVKR7NRPFCST1Z8666QEE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3b6055db59555e7656be6866ee92d58359928c6ae8c4e12f7dea980586505e13","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:04.677Z","job_size_bytes":1749,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-cb3a854c7d440ddeb0180659: start","job_status":"start","queue_duration_s":4.704439,"scheduling_latency_s":4.704461}2187gitlab # [ 253.360460] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.420Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"e2b41535-111f-40cb-a930-45754663d4d7\"}"],"class":"WebHookWorker","jid":"cb3a854c7d440ddeb0180659","created_at":"2026-08-20T05:57:04.674Z","trace_propagation_headers":{"sentry-trace":"8cb4c1ea73ab4341a94512459897f7cf-cfc1ffbf0713430d","baggage":"sentry-trace_id=8cb4c1ea73ab4341a94512459897f7cf,sentry-release=Unknown"},"correlation_id":"01M0EVVKR7NRPFCST1Z8666QEE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3b6055db59555e7656be6866ee92d58359928c6ae8c4e12f7dea980586505e13","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:04.677Z","job_size_bytes":1749,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-cb3a854c7d440ddeb0180659: done: 0.038864 sec","job_status":"done","queue_duration_s":4.704439,"scheduling_latency_s":4.704461,"redis_calls":14,"redis_duration_s":0.005507,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000299,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003929,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001279,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.006828242000011642,"cpu_s":0.016754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.038864,"completed_at":"2026-08-20T05:57:09.420Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003525,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2188gitlab # [ 253.396503] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/887f27e7d697883edeccf41f10639c0a5316948f HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1762189gitlab # [ 253.397105] nixbot[2614]: INFO: ::ffff:127.0.0.1:43718 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK2190gitlab # [ 253.397540] nixbot[2614]: {"ts": "2026-08-20T05:57:09.406Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/887f27e7d697883edeccf41f10639c0a5316948f \"HTTP/1.1 201 Created\""}2191gitlab # [ 253.397954] nixbot[2614]: INFO: ::ffff:127.0.0.1:43720 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2192gitlab # [ 253.398555] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.421Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f9f15e1bb7c462fd28aa2884","created_at":"2026-08-20T05:57:04.972Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:04.978Z","job_size_bytes":23,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f9f15e1bb7c462fd28aa2884: start","job_status":"start","queue_duration_s":4.443658,"scheduling_latency_s":4.443676}2193gitlab # [ 253.415561] gitaly[898]: time="2026-08-20T05:57:09.481Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXA5QNZYE5AW1Q61YPM93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:09.475" grpc.time_ms=5.944 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc2194gitlab # [ 253.418426] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 522195gitlab # [ 253.422979] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.488Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f9f15e1bb7c462fd28aa2884","created_at":"2026-08-20T05:57:04.972Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:04.978Z","job_size_bytes":23,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f9f15e1bb7c462fd28aa2884: done: 0.067113 sec","job_status":"done","queue_duration_s":4.443658,"scheduling_latency_s":4.443676,"redis_calls":10,"redis_duration_s":0.003334,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000327,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000294,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000293613,"duration_s":0.067113,"completed_at":"2026-08-20T05:57:09.488Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012702,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2196gitlab # [ 253.468173] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.490Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b12f7243344a7cb1df7a1216","created_at":"2026-08-20T05:57:05.173Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.177Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b12f7243344a7cb1df7a1216: start","job_status":"start","queue_duration_s":4.312442,"scheduling_latency_s":4.312455}2197gitlab # [ 253.468728] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.518Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b12f7243344a7cb1df7a1216","created_at":"2026-08-20T05:57:05.173Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.177Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b12f7243344a7cb1df7a1216: done: 0.02843 sec","job_status":"done","queue_duration_s":4.312442,"scheduling_latency_s":4.312455,"redis_calls":10,"redis_duration_s":0.0034059999999999997,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001995,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001138,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000447264,"duration_s":0.02843,"completed_at":"2026-08-20T05:57:09.518Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00562,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2198gitlab # [ 253.521450] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.519Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"f8d867ae4caf58d01ea81999","created_at":"2026-08-20T05:57:05.187Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.192Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-f8d867ae4caf58d01ea81999: start","job_status":"start","queue_duration_s":4.327088,"scheduling_latency_s":4.327102}2199gitlab # [ 253.522049] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.546Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"f8d867ae4caf58d01ea81999","created_at":"2026-08-20T05:57:05.187Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.192Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-f8d867ae4caf58d01ea81999: done: 0.027001 sec","job_status":"done","queue_duration_s":4.327088,"scheduling_latency_s":4.327102,"redis_calls":10,"redis_duration_s":0.001348,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000217905,"duration_s":0.027001,"completed_at":"2026-08-20T05:57:09.546Z","load_balancing_strategy":"primary","db_duration_s":0.008165,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2200gitlab # [ 253.546568] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.547Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f3f772f81ec164590e153b78","created_at":"2026-08-20T05:57:05.199Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.202Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f3f772f81ec164590e153b78: start","job_status":"start","queue_duration_s":4.345123,"scheduling_latency_s":4.345136}2201gitlab # [ 253.561562] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.569Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f3f772f81ec164590e153b78","created_at":"2026-08-20T05:57:05.199Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.202Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f3f772f81ec164590e153b78: done: 0.022208 sec","job_status":"done","queue_duration_s":4.345123,"scheduling_latency_s":4.345136,"redis_calls":13,"redis_duration_s":0.001664,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000253,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000368,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000221816,"duration_s":0.022208,"completed_at":"2026-08-20T05:57:09.569Z","load_balancing_strategy":"primary","db_duration_s":0.002953,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2202gitlab # [ 253.602501] gitlab-workhorse[822]: time="2026-08-20T05:57:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672203gitlab # [ 253.603985] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1232204gitlab # [ 253.605752] gitaly[898]: time="2026-08-20T05:57:09.609Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXA7EP90N1E9N8RMZKH7Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:09.600" pid=898 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2205gitlab # [ 253.607397] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.570Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a75222040f24294b3c8a9f00","created_at":"2026-08-20T05:57:05.203Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.206Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a75222040f24294b3c8a9f00: start","job_status":"start","queue_duration_s":4.36473,"scheduling_latency_s":4.364744}2206gitlab # [ 253.642617] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.590Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a75222040f24294b3c8a9f00","created_at":"2026-08-20T05:57:05.203Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.206Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a75222040f24294b3c8a9f00: done: 0.019618 sec","job_status":"done","queue_duration_s":4.36473,"scheduling_latency_s":4.364744,"redis_calls":10,"redis_duration_s":0.001546,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000496,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000789,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012849,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000205333,"duration_s":0.019618,"completed_at":"2026-08-20T05:57:09.590Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002611,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2207gitlab # [ 253.687865] gitaly[898]: time="2026-08-20T05:57:09.609Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXA7EP90N1E9N8RMZKH7Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:09.600" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc2208gitlab # [ 253.688826] nix-daemon[2819]: accepted connection from pid 3321, user nixbot2209gitlab # [ 253.689249] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.591Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"bf643aac0f0419f2b426ddf5","created_at":"2026-08-20T05:57:05.206Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.209Z","job_size_bytes":19,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-bf643aac0f0419f2b426ddf5: start","job_status":"start","queue_duration_s":4.381597,"scheduling_latency_s":4.381611}2210gitlab # [ 253.689807] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.616Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"bf643aac0f0419f2b426ddf5","created_at":"2026-08-20T05:57:05.206Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.209Z","job_size_bytes":19,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-bf643aac0f0419f2b426ddf5: done: 0.025636 sec","job_status":"done","queue_duration_s":4.381597,"scheduling_latency_s":4.381611,"redis_calls":11,"redis_duration_s":0.001778,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000389,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001074,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000315,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000221536,"duration_s":0.025636,"completed_at":"2026-08-20T05:57:09.616Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00497,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2211gitlab # [ 253.725635] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 522212gitlab # [ 253.726190] gitlab-workhorse[822]: time="2026-08-20T05:57:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672213gitlab # [ 253.726625] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 572214gitlab # [ 253.727104] gitaly[898]: time="2026-08-20T05:57:09.609Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXA7EP90N1E9N8RMZKH7Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:09.600" grpc.time_ms=8.836 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc2215gitlab # [ 253.730867] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.618Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"02948eb203e047582d0444a0","created_at":"2026-08-20T05:57:05.211Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.214Z","job_size_bytes":66,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-02948eb203e047582d0444a0: start","job_status":"start","queue_duration_s":4.403702,"scheduling_latency_s":4.403717}2216gitlab # [ 253.745532] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.662Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"02948eb203e047582d0444a0","created_at":"2026-08-20T05:57:05.211Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.214Z","job_size_bytes":66,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-02948eb203e047582d0444a0: done: 0.044855 sec","job_status":"done","queue_duration_s":4.403702,"scheduling_latency_s":4.403717,"redis_calls":10,"redis_duration_s":0.001457,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000301,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000215111,"duration_s":0.044855,"completed_at":"2026-08-20T05:57:09.662Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026287,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2217gitlab # [ 253.782669] gitaly[898]: time="2026-08-20T05:57:09.685Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXAC1DX4HXZHCN4D6NJT3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:09.678" grpc.time_ms=6.85 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc2218gitlab # [ 253.821889] gitaly[898]: time="2026-08-20T05:57:09.743Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXADP5R9679T7MV14J89N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:09.735" pid=898 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2219gitlab # [ 253.822954] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 492220gitlab # [ 253.823514] gitlab-workhorse[822]: time="2026-08-20T05:57:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162221gitlab # [ 253.823991] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 582222gitlab # [ 253.824709] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.663Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"0278792cc18e8ea29d142d29","created_at":"2026-08-20T05:57:05.214Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.218Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-0278792cc18e8ea29d142d29: start","job_status":"start","queue_duration_s":4.445847,"scheduling_latency_s":4.445862}2223gitlab # [ 253.825521] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.696Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"0278792cc18e8ea29d142d29","created_at":"2026-08-20T05:57:05.214Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.218Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-0278792cc18e8ea29d142d29: done: 0.03259 sec","job_status":"done","queue_duration_s":4.445847,"scheduling_latency_s":4.445862,"redis_calls":10,"redis_duration_s":0.004901,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002209,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0024,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000205892,"duration_s":0.03259,"completed_at":"2026-08-20T05:57:09.696Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00545,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2224gitlab # [ 253.861890] gitaly[898]: time="2026-08-20T05:57:09.743Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXADP5R9679T7MV14J89N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:09.735" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc2225gitlab # [ 253.866871] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.697Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a70640f5044afc53b9e1a78b","created_at":"2026-08-20T05:57:05.222Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.224Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a70640f5044afc53b9e1a78b: start","job_status":"start","queue_duration_s":4.472415,"scheduling_latency_s":4.472429}2226gitlab # [ 253.912675] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.748Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a70640f5044afc53b9e1a78b","created_at":"2026-08-20T05:57:05.222Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.224Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a70640f5044afc53b9e1a78b: done: 0.051417 sec","job_status":"done","queue_duration_s":4.472415,"scheduling_latency_s":4.472429,"redis_calls":10,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000276,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000228521,"duration_s":0.051417,"completed_at":"2026-08-20T05:57:09.748Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2227gitlab # [ 253.916318] gitaly[898]: time="2026-08-20T05:57:09.743Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXADP5R9679T7MV14J89N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:09.735" grpc.time_ms=7.582 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc2228gitlab # [ 253.952233] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.750Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2d817dcf51a980aad2141061","created_at":"2026-08-20T05:57:05.225Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.229Z","job_size_bytes":6,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2d817dcf51a980aad2141061: start","job_status":"start","queue_duration_s":4.521338,"scheduling_latency_s":4.521361}2229gitlab # [ 253.952795] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.766Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2d817dcf51a980aad2141061","created_at":"2026-08-20T05:57:05.225Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.229Z","job_size_bytes":6,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2d817dcf51a980aad2141061: done: 0.016243 sec","job_status":"done","queue_duration_s":4.521338,"scheduling_latency_s":4.521361,"redis_calls":10,"redis_duration_s":0.001614,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000244,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000415,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000216788,"duration_s":0.016243,"completed_at":"2026-08-20T05:57:09.766Z","load_balancing_strategy":"primary","db_duration_s":0.001919,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2230gitlab # [ 253.991822] gitaly[898]: time="2026-08-20T05:57:09.817Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXAG8DVBWYJQ8FS2T1T6Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=196 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:09.809" grpc.time_ms=8.77 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc2231gitlab # [ 253.992631] gitaly[898]: time="2026-08-20T05:57:09.878Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXAHXMD2HBQ7W1RZW1M6P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:09.867" pid=898 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2232gitlab # [ 253.994691] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.767Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e20cf12269b727b07cb3bdaa","created_at":"2026-08-20T05:57:05.229Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.232Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e20cf12269b727b07cb3bdaa: start","job_status":"start","queue_duration_s":4.535266,"scheduling_latency_s":4.535279}2233gitlab # [ 254.006975] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.792Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e20cf12269b727b07cb3bdaa","created_at":"2026-08-20T05:57:05.229Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.232Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e20cf12269b727b07cb3bdaa: done: 0.024577 sec","job_status":"done","queue_duration_s":4.535266,"scheduling_latency_s":4.535279,"redis_calls":10,"redis_duration_s":0.00245,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000237,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001273,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000613766,"duration_s":0.024577,"completed_at":"2026-08-20T05:57:09.792Z","load_balancing_strategy":"primary","db_duration_s":0.004504,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2234gitlab # [ 254.042684] gitaly[898]: time="2026-08-20T05:57:09.878Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1165 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXAHXMD2HBQ7W1RZW1M6P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:09.867" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc2235gitlab # [ 254.085991] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.794Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"1badd81249d188d996d589a8","created_at":"2026-08-20T05:57:05.236Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.239Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-1badd81249d188d996d589a8: start","job_status":"start","queue_duration_s":4.554321,"scheduling_latency_s":4.554336}2236gitlab # [ 254.086528] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.841Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"1badd81249d188d996d589a8","created_at":"2026-08-20T05:57:05.236Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.239Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-1badd81249d188d996d589a8: done: 0.047306 sec","job_status":"done","queue_duration_s":4.554321,"scheduling_latency_s":4.554336,"redis_calls":14,"redis_duration_s":0.00696,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001994,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004688,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000393905,"duration_s":0.047306,"completed_at":"2026-08-20T05:57:09.841Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008502,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2237gitlab # [ 254.131821] gitaly[898]: time="2026-08-20T05:57:09.880Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1165 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXAHXMD2HBQ7W1RZW1M6P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:09.867" grpc.time_ms=11.939 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc2238gitlab # [ 254.132516] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:09.842Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"7ae1673c5645e42c0c20c00a","created_at":"2026-08-20T05:57:05.306Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.308Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7ae1673c5645e42c0c20c00a: start","job_status":"start","queue_duration_s":4.533836,"scheduling_latency_s":4.533851}2239gitlab # [ 254.133101] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.013Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"7ae1673c5645e42c0c20c00a","created_at":"2026-08-20T05:57:05.306Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.308Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2609,"job_status":"rescheduled","message":"PipelineProcessWorker JID-7ae1673c5645e42c0c20c00a: rescheduled"}2240gitlab # [ 254.138783] gitaly[898]: time="2026-08-20T05:57:09.906Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:09.906" grpc.time_ms=0.27 pid=898 span.kind=server system=grpc2241gitlab # [ 254.176083] gitaly[898]: time="2026-08-20T05:57:09.922Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:09.921" grpc.time_ms=0.237 pid=898 span.kind=server system=grpc2242gitlab # [ 254.176761] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.019Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"7ae1673c5645e42c0c20c00a","created_at":"2026-08-20T05:57:05.306Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-e35dba4d3c424422","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:05.308Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7ae1673c5645e42c0c20c00a: done: 0.176797 sec","job_status":"done","queue_duration_s":4.533836,"scheduling_latency_s":4.533851,"gitaly_calls":3,"gitaly_duration_s":0.073078,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.009064,"redis_read_bytes":149,"redis_write_bytes":18012,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000374,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00059,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002137,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12311,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.003208,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000152,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00063,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001599,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07533,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.152517708,"duration_s":0.176797,"completed_at":"2026-08-20T05:57:10.019Z","load_balancing_strategy":"primary","db_duration_s":0.022343,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2243gitlab # [ 254.195716] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.022Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"3c5f2c6b012c498f92cbcb9f","created_at":"2026-08-20T05:57:07.518Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-fd6076e72afc478c","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.522Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-3c5f2c6b012c498f92cbcb9f: start","job_status":"start","queue_duration_s":2.500758,"scheduling_latency_s":2.500775}2244gitlab # [ 254.232049] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3222245gitlab # [ 254.232712] gitaly[898]: time="2026-08-20T05:57:09.940Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:09.940" grpc.time_ms=0.223 pid=898 span.kind=server system=grpc2246gitlab # [ 254.233380] gitaly[898]: time="2026-08-20T05:57:09.950Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 diskcache=c9fef427-a8d6-4c46-9e3b-5983ee647ed0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:39.685" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:09.886" pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2247gitlab # [ 254.234133] nixbot[2614]: {"ts": "2026-08-20T05:57:10.232Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d3f019c6d0414710c10bcfe109e2734c66b33866 \"HTTP/1.1 201 Created\""}2248gitlab # [ 254.234520] nixbot[2614]: {"ts": "2026-08-20T05:57:10.237Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-d3f019c6d041-4"}2249gitlab # [ 254.234939] nix-daemon[2819]: accepted connection from pid 3410, user nixbot2250gitlab # [ 254.235370] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.074Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"3c5f2c6b012c498f92cbcb9f","created_at":"2026-08-20T05:57:07.518Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-fd6076e72afc478c","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.522Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-3c5f2c6b012c498f92cbcb9f: done: 0.051338 sec","job_status":"done","queue_duration_s":2.500758,"scheduling_latency_s":2.500775,"redis_calls":19,"redis_duration_s":0.01913,"redis_read_bytes":22,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000507,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.015734,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001824,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.022111748,"duration_s":0.051338,"completed_at":"2026-08-20T05:57:10.074Z","load_balancing_strategy":"primary","db_duration_s":0.005013,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2251gitlab # [ 254.277635] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.075Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","b9487bcce5e3bcf5699d41d1"],"class":"WebHooks::LogExecutionWorker","jid":"4136973d8030e63ab0b1c7bd","created_at":"2026-08-20T05:57:08.651Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-024a2a0934ac45b6","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ce0b81c84aefc708f5ba9941ad23be20d66e2e5f14aea8362822cdfde00d771d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.656Z","job_size_bytes":2593,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-4136973d8030e63ab0b1c7bd: start","job_status":"start","queue_duration_s":1.419215,"scheduling_latency_s":1.419229}2252gitlab # [ 254.279857] gitaly[898]: time="2026-08-20T05:57:09.950Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=53 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7205 command.oublock=0 command.real_time_ms=56 command.spawn_token_fork_ms=0 command.system_time_ms=31 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:39.685" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:09.886" grpc.time_ms=64.497 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2253gitlab # [ 254.320651] nix-daemon[2819]: accepted connection from pid 3418, user nixbot2254gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866'2255gitlab # [ 254.321273] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.114Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","b9487bcce5e3bcf5699d41d1"],"class":"WebHooks::LogExecutionWorker","jid":"4136973d8030e63ab0b1c7bd","created_at":"2026-08-20T05:57:08.651Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-024a2a0934ac45b6","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ce0b81c84aefc708f5ba9941ad23be20d66e2e5f14aea8362822cdfde00d771d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.656Z","job_size_bytes":2593,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-4136973d8030e63ab0b1c7bd: done: 0.038507 sec","job_status":"done","queue_duration_s":1.419215,"scheduling_latency_s":1.419229,"redis_calls":10,"redis_duration_s":0.0016779999999999998,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0003,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000296686,"duration_s":0.038507,"completed_at":"2026-08-20T05:57:10.114Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01302,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2256gitlab # [ 254.357673] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.115Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","cb3a854c7d440ddeb0180659"],"class":"WebHooks::LogExecutionWorker","jid":"3c8475e77e0605b815cee6bc","created_at":"2026-08-20T05:57:09.414Z","trace_propagation_headers":{"sentry-trace":"8cb4c1ea73ab4341a94512459897f7cf-dad0f0c26fea40eb","baggage":"sentry-trace_id=8cb4c1ea73ab4341a94512459897f7cf,sentry-release=Unknown"},"correlation_id":"01M0EVVKR7NRPFCST1Z8666QEE","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b1ff53bec9bd9535a2d24fe10266f6f00605c671735624fc44b5f7baf2bb5aa","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.416Z","job_size_bytes":2592,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-3c8475e77e0605b815cee6bc: start","job_status":"start","queue_duration_s":0.698801,"scheduling_latency_s":0.698816}2257gitlab # [ 254.358447] gitaly[898]: time="2026-08-20T05:57:09.990Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:57:39.786" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:09.986" grpc.time_ms=3.479 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2258gitlab # [ 254.358993] nixbot[2614]: {"ts": "2026-08-20T05:57:10.349Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-d3f019c6d041-4", "argv0": "bwrap"}2259gitlab # [ 254.359659] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.137Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","cb3a854c7d440ddeb0180659"],"class":"WebHooks::LogExecutionWorker","jid":"3c8475e77e0605b815cee6bc","created_at":"2026-08-20T05:57:09.414Z","trace_propagation_headers":{"sentry-trace":"8cb4c1ea73ab4341a94512459897f7cf-dad0f0c26fea40eb","baggage":"sentry-trace_id=8cb4c1ea73ab4341a94512459897f7cf,sentry-release=Unknown"},"correlation_id":"01M0EVVKR7NRPFCST1Z8666QEE","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b1ff53bec9bd9535a2d24fe10266f6f00605c671735624fc44b5f7baf2bb5aa","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.416Z","job_size_bytes":2592,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-3c8475e77e0605b815cee6bc: done: 0.022833 sec","job_status":"done","queue_duration_s":0.698801,"scheduling_latency_s":0.698816,"redis_calls":7,"redis_duration_s":0.001766,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001393,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000373,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022833,"completed_at":"2026-08-20T05:57:10.137Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003086,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2260gitlab # [ 254.398459] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.139Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"6b7be8e2f77e6b256776db08","created_at":"2026-08-20T05:57:09.880Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.882Z","job_size_bytes":23,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-6b7be8e2f77e6b256776db08: start","job_status":"start","queue_duration_s":0.256835,"scheduling_latency_s":0.256854}2261gitlab # [ 254.399411] gitaly[898]: time="2026-08-20T05:57:10.008Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVVM39ARQZC3NEN7GYKP07 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:40.007" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:10.008" grpc.time_ms=0.418 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2262gitlab # [ 254.408475] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.169Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"6b7be8e2f77e6b256776db08","created_at":"2026-08-20T05:57:09.880Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.882Z","job_size_bytes":23,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-6b7be8e2f77e6b256776db08: done: 0.03026 sec","job_status":"done","queue_duration_s":0.256835,"scheduling_latency_s":0.256854,"redis_calls":7,"redis_duration_s":0.001146,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03026,"completed_at":"2026-08-20T05:57:10.169Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005862,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2263gitlab # [ 254.469188] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.170Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5ae84e42a36a4c9188fc75a8","created_at":"2026-08-20T05:57:09.955Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.957Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5ae84e42a36a4c9188fc75a8: start","job_status":"start","queue_duration_s":0.213454,"scheduling_latency_s":0.213473}2264gitlab # [ 254.469888] gitaly[898]: time="2026-08-20T05:57:10.016Z" level=info msg="finished unary call with code OK" catfile.duration_ms=71 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=71 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXAMNMFRRJMD31G3E691D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:39.243" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:09.943" grpc.time_ms=73.375 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2265gitlab # [ 254.470429] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.187Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5ae84e42a36a4c9188fc75a8","created_at":"2026-08-20T05:57:09.955Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.957Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5ae84e42a36a4c9188fc75a8: done: 0.01716 sec","job_status":"done","queue_duration_s":0.213454,"scheduling_latency_s":0.213473,"redis_calls":7,"redis_duration_s":0.001094,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000839,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01716,"completed_at":"2026-08-20T05:57:10.187Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002771,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2266gitlab # [ 254.510541] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.188Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"b13a156ded6f399ed6539bdb","created_at":"2026-08-20T05:57:09.961Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.962Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-b13a156ded6f399ed6539bdb: start","job_status":"start","queue_duration_s":0.225611,"scheduling_latency_s":0.225627}2267gitlab # [ 254.511673] gitaly[898]: time="2026-08-20T05:57:10.031Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXAMNMFRRJMD31G3E691D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T05:57:40.024" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:10.026" grpc.time_ms=5.404 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2268gitlab # [ 254.523263] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.211Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"b13a156ded6f399ed6539bdb","created_at":"2026-08-20T05:57:09.961Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.962Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-b13a156ded6f399ed6539bdb: done: 0.022772 sec","job_status":"done","queue_duration_s":0.225611,"scheduling_latency_s":0.225627,"redis_calls":7,"redis_duration_s":0.003058,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002228,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00083,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022772,"completed_at":"2026-08-20T05:57:10.211Z","load_balancing_strategy":"primary","db_duration_s":0.005646,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2269gitlab # [ 254.566181] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.213Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"71b29ee8607f3caf90993b2c","created_at":"2026-08-20T05:57:09.967Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.968Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-71b29ee8607f3caf90993b2c: start","job_status":"start","queue_duration_s":0.244761,"scheduling_latency_s":0.244784}2270gitlab # [ 254.570478] gitaly[898]: time="2026-08-20T05:57:10.041Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXAMNMFRRJMD31G3E691D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:20.035" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:10.036" grpc.time_ms=5.554 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2271gitlab # [ 254.581623] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.234Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"71b29ee8607f3caf90993b2c","created_at":"2026-08-20T05:57:09.967Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.968Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-71b29ee8607f3caf90993b2c: done: 0.021085 sec","job_status":"done","queue_duration_s":0.244761,"scheduling_latency_s":0.244784,"redis_calls":10,"redis_duration_s":0.0016359999999999999,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000352,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000438,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021085,"completed_at":"2026-08-20T05:57:10.234Z","load_balancing_strategy":"primary","db_duration_s":0.002752,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2272gitlab # [ 254.641605] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.235Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e2a03ffdd04c36495f78937b","created_at":"2026-08-20T05:57:09.969Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.970Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e2a03ffdd04c36495f78937b: start","job_status":"start","queue_duration_s":0.265543,"scheduling_latency_s":0.265559}2273gitlab # [ 254.642600] gitaly[898]: time="2026-08-20T05:57:10.096Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXAMNMFRRJMD31G3E691D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:57:20.096" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:10.096" grpc.time_ms=0.196 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2274gitlab # [ 254.643486] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e2a03ffdd04c36495f78937b","created_at":"2026-08-20T05:57:09.969Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.970Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e2a03ffdd04c36495f78937b: done: 0.028279 sec","job_status":"done","queue_duration_s":0.265543,"scheduling_latency_s":0.265559,"redis_calls":7,"redis_duration_s":0.002228,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001925,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028279,"completed_at":"2026-08-20T05:57:10.263Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013108,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2275gitlab # [ 254.684952] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6ce999caa76d58af39f59d7d","created_at":"2026-08-20T05:57:09.970Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.971Z","job_size_bytes":19,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6ce999caa76d58af39f59d7d: start","job_status":"start","queue_duration_s":0.293116,"scheduling_latency_s":0.293141}2276gitlab # [ 254.686666] gitaly[898]: time="2026-08-20T05:57:10.106Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXAMNMFRRJMD31G3E691D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:57:20.099" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:10.099" grpc.time_ms=6.376 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2277gitlab # [ 254.697243] gitaly[898]: time="2026-08-20T05:57:10.139Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVXAMNMFRRJMD31G3E691D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:10.138" grpc.time_ms=0.311 pid=898 span.kind=server system=grpc2278gitlab # [ 254.705165] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.279Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6ce999caa76d58af39f59d7d","created_at":"2026-08-20T05:57:09.970Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.971Z","job_size_bytes":19,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6ce999caa76d58af39f59d7d: done: 0.014138 sec","job_status":"done","queue_duration_s":0.293116,"scheduling_latency_s":0.293141,"redis_calls":8,"redis_duration_s":0.001082,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014138,"completed_at":"2026-08-20T05:57:10.279Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002092,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2279gitlab # [ 254.752047] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.279Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a2b193ecbd94d6ec495f0ec3","created_at":"2026-08-20T05:57:09.972Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.973Z","job_size_bytes":66,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a2b193ecbd94d6ec495f0ec3: start","job_status":"start","queue_duration_s":0.306574,"scheduling_latency_s":0.306598}2280gitlab # [ 254.752804] gitaly[898]: time="2026-08-20T05:57:10.157Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVXAMNMFRRJMD31G3E691D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:10.157" grpc.time_ms=0.358 pid=898 span.kind=server system=grpc2281gitlab # [ 254.760519] gitaly[898]: time="2026-08-20T05:57:10.169Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXAMNMFRRJMD31G3E691D diskcache=b91f5259-a4f3-4eee-bc5f-b4fc22f15c60 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:57:20.107" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:10.107" pid=898 ref=refs/keep-around/d3f019c6d0414710c10bcfe109e2734c66b33866 remote_ip="2001:db8:1::1" revision=d3f019c6d0414710c10bcfe109e2734c66b33866 span.kind=server system=grpc username=root2282gitlab # [ 254.796557] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.297Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a2b193ecbd94d6ec495f0ec3","created_at":"2026-08-20T05:57:09.972Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.973Z","job_size_bytes":66,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a2b193ecbd94d6ec495f0ec3: done: 0.017104 sec","job_status":"done","queue_duration_s":0.306574,"scheduling_latency_s":0.306598,"redis_calls":7,"redis_duration_s":0.001101,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000831,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017104,"completed_at":"2026-08-20T05:57:10.297Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001965,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2283gitlab # [ 254.803820] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.299Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"84c00ba81bde1a94c70a158e","created_at":"2026-08-20T05:57:09.973Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.974Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-84c00ba81bde1a94c70a158e: start","job_status":"start","queue_duration_s":0.324386,"scheduling_latency_s":0.324421}2284gitlab # [ 254.817130] gitaly[898]: time="2026-08-20T05:57:10.169Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=38 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5265 command.oublock=8 command.real_time_ms=52 command.spawn_token_fork_ms=2 command.system_time_ms=26 command.user_time_ms=12 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXAMNMFRRJMD31G3E691D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:57:20.107" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:10.107" grpc.time_ms=61.716 pid=898 ref=refs/keep-around/d3f019c6d0414710c10bcfe109e2734c66b33866 remote_ip="2001:db8:1::1" revision=d3f019c6d0414710c10bcfe109e2734c66b33866 span.kind=server system=grpc username=root2285gitlab # [ 254.858631] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.319Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"84c00ba81bde1a94c70a158e","created_at":"2026-08-20T05:57:09.973Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.974Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-84c00ba81bde1a94c70a158e: done: 0.020384 sec","job_status":"done","queue_duration_s":0.324386,"scheduling_latency_s":0.324421,"redis_calls":7,"redis_duration_s":0.001092,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000793,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000299,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020384,"completed_at":"2026-08-20T05:57:10.319Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003849,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2286gitlab # [ 254.862434] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.320Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"a66056856c507c980a25b765","created_at":"2026-08-20T05:57:09.974Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.975Z","job_size_bytes":6,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-a66056856c507c980a25b765: start","job_status":"start","queue_duration_s":0.344542,"scheduling_latency_s":0.344556}2287gitlab # [ 254.901365] gitaly[898]: time="2026-08-20T05:57:10.172Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXAMNMFRRJMD31G3E691D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:40.172" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:10.172" grpc.time_ms=0.286 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2288gitlab # [ 254.902045] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.328Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"a66056856c507c980a25b765","created_at":"2026-08-20T05:57:09.974Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.975Z","job_size_bytes":6,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-a66056856c507c980a25b765: done: 0.008522 sec","job_status":"done","queue_duration_s":0.344542,"scheduling_latency_s":0.344556,"redis_calls":7,"redis_duration_s":0.000962,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000687,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008522,"completed_at":"2026-08-20T05:57:10.328Z","load_balancing_strategy":"primary","db_duration_s":0.000266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2289gitlab # [ 254.951791] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.329Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"96b4de7aede076e4e25ad6a5","created_at":"2026-08-20T05:57:09.975Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.976Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-96b4de7aede076e4e25ad6a5: start","job_status":"start","queue_duration_s":0.352815,"scheduling_latency_s":0.352829}2290gitlab # [ 254.952570] gitaly[898]: time="2026-08-20T05:57:10.664Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXAMNMFRRJMD31G3E691D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:57:40.463" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:10.663" grpc.time_ms=0.961 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2291gitlab # [ 254.953136] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.343Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"96b4de7aede076e4e25ad6a5","created_at":"2026-08-20T05:57:09.975Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:09.976Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-96b4de7aede076e4e25ad6a5: done: 0.013676 sec","job_status":"done","queue_duration_s":0.352815,"scheduling_latency_s":0.352829,"redis_calls":7,"redis_duration_s":0.000976,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013676,"completed_at":"2026-08-20T05:57:10.343Z","load_balancing_strategy":"primary","db_duration_s":0.001998,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2292gitlab # [ 255.004683] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.344Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"c68937d0d3e17911e566fbee","created_at":"2026-08-20T05:57:10.013Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:10.014Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c68937d0d3e17911e566fbee: start","job_status":"start","queue_duration_s":0.329609,"scheduling_latency_s":0.329624}2293gitlab # [ 255.005409] gitaly[898]: time="2026-08-20T05:57:10.687Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXAMNMFRRJMD31G3E691D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:40.486" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:10.687" grpc.time_ms=0.563 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2294gitlab # [ 255.005982] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.359Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"c68937d0d3e17911e566fbee","created_at":"2026-08-20T05:57:10.013Z","trace_propagation_headers":{"sentry-trace":"81197447486546988f12e3436924c92b-c6f84af99a9a4032","baggage":"sentry-trace_id=81197447486546988f12e3436924c92b,sentry-release=Unknown"},"correlation_id":"01M0EVVM39ARQZC3NEN7GYKP07","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:10.014Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c68937d0d3e17911e566fbee: done: 0.015134 sec","job_status":"done","queue_duration_s":0.329609,"scheduling_latency_s":0.329624,"redis_calls":8,"redis_duration_s":0.001105,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000853,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000252,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015134,"completed_at":"2026-08-20T05:57:10.359Z","load_balancing_strategy":"primary","db_duration_s":0.00205,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2295gitlab # [ 255.046091] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.360Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"22a5db8ccd2c35d6754b4ba0","created_at":"2026-08-20T05:57:10.047Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-07cc7ee7c5b14657","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:10.052Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-22a5db8ccd2c35d6754b4ba0: start","job_status":"start","queue_duration_s":0.308153,"scheduling_latency_s":0.308169}2296gitlab # [ 255.046794] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.425Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"22a5db8ccd2c35d6754b4ba0","created_at":"2026-08-20T05:57:10.047Z","trace_propagation_headers":{"sentry-trace":"ddb11a48b47c4f22ae34bb126a818cc1-07cc7ee7c5b14657","baggage":"sentry-trace_id=ddb11a48b47c4f22ae34bb126a818cc1,sentry-release=Unknown"},"correlation_id":"01M0EVVFJQY0MYHNYHZVK8JRH6","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:10.052Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-22a5db8ccd2c35d6754b4ba0: done: 0.06494 sec","job_status":"done","queue_duration_s":0.308153,"scheduling_latency_s":0.308169,"redis_calls":11,"redis_duration_s":0.001748,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000257,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001205,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000263162,"duration_s":0.06494,"completed_at":"2026-08-20T05:57:10.425Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014141,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2297gitlab # [ 255.080568] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.428Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"84d9b42a242b1a5277f52678","created_at":"2026-08-20T05:57:10.173Z","trace_propagation_headers":{"sentry-trace":"4b6e2f7d68e2474ab3666be315c16fd7-22009307129e459c","baggage":"sentry-trace_id=4b6e2f7d68e2474ab3666be315c16fd7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXAMNMFRRJMD31G3E691D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:10.177Z","job_size_bytes":65,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-84d9b42a242b1a5277f52678: start","job_status":"start","queue_duration_s":0.250714,"scheduling_latency_s":0.25073}2298gitlab # [ 255.116851] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.458Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"84d9b42a242b1a5277f52678","created_at":"2026-08-20T05:57:10.173Z","trace_propagation_headers":{"sentry-trace":"4b6e2f7d68e2474ab3666be315c16fd7-22009307129e459c","baggage":"sentry-trace_id=4b6e2f7d68e2474ab3666be315c16fd7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXAMNMFRRJMD31G3E691D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:10.177Z","job_size_bytes":65,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-84d9b42a242b1a5277f52678: done: 0.030561 sec","job_status":"done","queue_duration_s":0.250714,"scheduling_latency_s":0.25073,"redis_calls":7,"redis_duration_s":0.00513,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003401,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001729,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030561,"completed_at":"2026-08-20T05:57:10.458Z","load_balancing_strategy":"primary","db_duration_s":0.003161,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2299gitlab # [ 255.160684] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.459Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b62c93da25a2f222508e9dba","created_at":"2026-08-20T05:57:10.179Z","trace_propagation_headers":{"sentry-trace":"4b6e2f7d68e2474ab3666be315c16fd7-22009307129e459c","baggage":"sentry-trace_id=4b6e2f7d68e2474ab3666be315c16fd7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXAMNMFRRJMD31G3E691D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:10.180Z","job_size_bytes":65,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b62c93da25a2f222508e9dba: start","job_status":"start","queue_duration_s":0.27895,"scheduling_latency_s":0.278967}2300gitlab # [ 255.161556] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.598Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b62c93da25a2f222508e9dba","created_at":"2026-08-20T05:57:10.179Z","trace_propagation_headers":{"sentry-trace":"4b6e2f7d68e2474ab3666be315c16fd7-22009307129e459c","baggage":"sentry-trace_id=4b6e2f7d68e2474ab3666be315c16fd7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXAMNMFRRJMD31G3E691D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:10.180Z","job_size_bytes":65,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b62c93da25a2f222508e9dba: done: 0.138651 sec","job_status":"done","queue_duration_s":0.27895,"scheduling_latency_s":0.278967,"redis_calls":10,"redis_duration_s":0.0023290000000000003,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001409,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.123061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.138651,"completed_at":"2026-08-20T05:57:10.598Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009736,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2301gitlab # [ 255.206775] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.599Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"4c94dac272b7038a2a0aa033","created_at":"2026-08-20T05:57:10.219Z","trace_propagation_headers":{"sentry-trace":"4b6e2f7d68e2474ab3666be315c16fd7-22009307129e459c","baggage":"sentry-trace_id=4b6e2f7d68e2474ab3666be315c16fd7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXAMNMFRRJMD31G3E691D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:10.222Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4c94dac272b7038a2a0aa033: start","job_status":"start","queue_duration_s":0.377767,"scheduling_latency_s":0.37779}2302gitlab # [ 255.207573] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.700Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"4c94dac272b7038a2a0aa033","created_at":"2026-08-20T05:57:10.219Z","trace_propagation_headers":{"sentry-trace":"4b6e2f7d68e2474ab3666be315c16fd7-22009307129e459c","baggage":"sentry-trace_id=4b6e2f7d68e2474ab3666be315c16fd7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXAMNMFRRJMD31G3E691D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:10.222Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4c94dac272b7038a2a0aa033: done: 0.100308 sec","job_status":"done","queue_duration_s":0.377767,"scheduling_latency_s":0.37779,"gitaly_calls":2,"gitaly_duration_s":0.005269,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.005387,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000854,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000886,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000214,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001164,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000196,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000307,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071549,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.073782562,"duration_s":0.100308,"completed_at":"2026-08-20T05:57:10.700Z","load_balancing_strategy":"primary","db_duration_s":0.02156,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2303gitlab # [ 255.243521] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.701Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"42bec427189c10f712b4f00d","created_at":"2026-08-20T05:57:10.651Z","trace_propagation_headers":{"sentry-trace":"4b6e2f7d68e2474ab3666be315c16fd7-829658a7c21e49a0","baggage":"sentry-trace_id=4b6e2f7d68e2474ab3666be315c16fd7,sentry-release=Unknown"},"correlation_id":"01M0EVXAMNMFRRJMD31G3E691D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:10.653Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-42bec427189c10f712b4f00d: start","job_status":"start","queue_duration_s":0.047929,"scheduling_latency_s":0.047947}2304gitlab # [ 255.245093] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:10.730Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"42bec427189c10f712b4f00d","created_at":"2026-08-20T05:57:10.651Z","trace_propagation_headers":{"sentry-trace":"4b6e2f7d68e2474ab3666be315c16fd7-829658a7c21e49a0","baggage":"sentry-trace_id=4b6e2f7d68e2474ab3666be315c16fd7,sentry-release=Unknown"},"correlation_id":"01M0EVXAMNMFRRJMD31G3E691D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:10.653Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-42bec427189c10f712b4f00d: done: 0.029546 sec","job_status":"done","queue_duration_s":0.047929,"scheduling_latency_s":0.047947,"redis_calls":7,"redis_duration_s":0.001062,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029546,"completed_at":"2026-08-20T05:57:10.730Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2305gitlab # [ 255.336163] nixbot[2614]: INFO: ::ffff:127.0.0.1:43732 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 200 OK2306gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d3f019c6d0414710c10bcfe109e2734c66b33866', in 1.02 seconds)2307(finished: subtest: push delivers the webhook, in 58.03 seconds)2308subtest: eval and build post commit statuses2309gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d3f019c6d0414710c10bcfe109e2734c66b33866/statuses2310gitlab # [ 255.389516] nix-daemon[2819]: accepted connection from pid 3433, user nixbot2311gitlab # [ 255.417301] gitaly[898]: time="2026-08-20T05:57:11.483Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXC4N3PKXHF8MS7F5997V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:41.481" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:11.482" grpc.time_ms=0.613 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2312gitlab # [ 255.435257] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d3f019c6d0414710c10bcfe109e2734c66b33866/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 542313gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d3f019c6d0414710c10bcfe109e2734c66b33866/statuses, in 0.09 seconds)2314gitlab # [ 255.451150] nix-daemon[2819]: accepted connection from pid 3449, user nixbot2315gitlab # [ 255.461694] nix-daemon[2819]: accepted connection from pid 3433, user nixbot2316gitlab # [ 255.534641] gitaly[898]: time="2026-08-20T05:57:11.600Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXC83P32T9TWG8692BP2R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:41.599" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:11.600" grpc.time_ms=0.506 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2317gitlab # [ 255.621558] gitaly[898]: time="2026-08-20T05:57:11.687Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXC83P32T9TWG8692BP2R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:21.264" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:11.675" grpc.time_ms=12.166 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2318gitlab # [ 255.669128] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:11.734Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2b113ab0358203633be5b213","created_at":"2026-08-20T05:57:11.728Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-233a25456e464005","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.732Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2b113ab0358203633be5b213: start","job_status":"start","queue_duration_s":0.001762,"scheduling_latency_s":0.001805}2319gitlab # [ 255.728234] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2382320gitlab # [ 255.730700] nixbot[2614]: {"ts": "2026-08-20T05:57:11.796Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d3f019c6d0414710c10bcfe109e2734c66b33866 \"HTTP/1.1 201 Created\""}2321gitlab # [ 255.771232] gitaly[898]: time="2026-08-20T05:57:11.837Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVXC83P32T9TWG8692BP2R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:11.836" grpc.time_ms=0.424 pid=898 span.kind=server system=grpc2322gitlab # [ 255.815600] gitaly[898]: time="2026-08-20T05:57:11.881Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVXC83P32T9TWG8692BP2R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:11.881" grpc.time_ms=0.36 pid=898 span.kind=server system=grpc2323gitlab # [ 255.843400] gitaly[898]: time="2026-08-20T05:57:11.909Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXCFT85J6QSW4RHFK93SQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:41.408" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:11.908" grpc.time_ms=0.528 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2324gitlab # [ 255.856760] gitaly[898]: time="2026-08-20T05:57:11.923Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVXC83P32T9TWG8692BP2R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:11.922" grpc.time_ms=0.303 pid=898 span.kind=server system=grpc2325gitlab # [ 255.870341] gitaly[898]: time="2026-08-20T05:57:11.936Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXC83P32T9TWG8692BP2R forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:41.602" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:11.802" operations="[repack_refs]" pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2326gitlab # [ 255.878927] gitaly[898]: time="2026-08-20T05:57:11.938Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXC83P32T9TWG8692BP2R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:41.602" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:11.802" pid=898 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-20 05:56:07.956597395 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2327gitlab # [ 255.890725] gitaly[898]: time="2026-08-20T05:57:11.957Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXC83P32T9TWG8692BP2R diskcache=6b015985-f400-40da-8f61-ad6334afc8bc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:41.602" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:11.802" pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2328gitlab # [ 255.891061] gitaly[898]: time="2026-08-20T05:57:11.957Z" level=info msg="finished unary call with code OK" command.count=4 command.cpu_time_ms=148 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=8511 command.oublock=0 command.real_time_ms=140 command.spawn_token_fork_ms=0 command.system_time_ms=109 command.user_time_ms=39 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXC83P32T9TWG8692BP2R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:41.602" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:11.802" grpc.time_ms=154.562 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2329gitlab # [ 255.892299] gitaly[898]: time="2026-08-20T05:57:11.958Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXC83P32T9TWG8692BP2R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:41.602" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:11.802" pid=898 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2330gitlab # [ 255.893182] gitaly[898]: time="2026-08-20T05:57:11.959Z" level=info msg="optimized repository" clean_stale_data_time=13.610668ms clean_work_trees_time="71.238µs" commit_graph_time="3.911µs" correlation_id=01M0EVXC83P32T9TWG8692BP2R gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.911µs" pid=898 prune_time="3.073µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.749µs" storage_name=default system=housekeeping total_time=13.821031ms2331gitlab # [ 255.893827] gitaly[898]: time="2026-08-20T05:57:11.959Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXC83P32T9TWG8692BP2R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:41.602" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:11.802" pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2332gitlab # [ 255.904110] gitaly[898]: time="2026-08-20T05:57:11.970Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXCFT85J6QSW4RHFK93SQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:21.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:11.965" grpc.time_ms=4.504 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2333gitlab # [ 255.942584] gitaly[898]: time="2026-08-20T05:57:12.008Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXC83P32T9TWG8692BP2R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:57:42.007" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:12.008" grpc.time_ms=0.678 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2334gitlab # [ 255.964377] gitaly[898]: time="2026-08-20T05:57:12.030Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXC83P32T9TWG8692BP2R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:42.029" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:12.029" grpc.time_ms=0.61 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2335gitlab # [ 255.976511] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.041Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2b113ab0358203633be5b213","created_at":"2026-08-20T05:57:11.728Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-233a25456e464005","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.732Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2b113ab0358203633be5b213: done: 0.307907 sec","job_status":"done","queue_duration_s":0.001762,"scheduling_latency_s":0.001805,"gitaly_calls":3,"gitaly_duration_s":0.162868,"redis_calls":73,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.012689,"redis_read_bytes":154,"redis_write_bytes":20034,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001022,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001427,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":23,"redis_queues_duration_s":0.002229,"redis_queues_read_bytes":25,"redis_queues_write_bytes":13379,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.004169,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3094,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000276,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000793,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001751,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.01,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.103251,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.273958283,"duration_s":0.307907,"completed_at":"2026-08-20T05:57:12.041Z","load_balancing_strategy":"primary","db_duration_s":0.034408,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2336gitlab # [ 256.019991] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.086Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"4326901f06d699c5fd26f7e3","created_at":"2026-08-20T05:57:11.796Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.798Z","job_size_bytes":23,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-4326901f06d699c5fd26f7e3: start","job_status":"start","queue_duration_s":0.287526,"scheduling_latency_s":0.287553}2337gitlab # [ 256.059823] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3232338gitlab # [ 256.062228] nixbot[2614]: {"ts": "2026-08-20T05:57:12.127Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d3f019c6d0414710c10bcfe109e2734c66b33866 \"HTTP/1.1 201 Created\""}2339gitlab # [ 256.086466] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"4326901f06d699c5fd26f7e3","created_at":"2026-08-20T05:57:11.796Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.798Z","job_size_bytes":23,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-4326901f06d699c5fd26f7e3: done: 0.066257 sec","job_status":"done","queue_duration_s":0.287526,"scheduling_latency_s":0.287553,"redis_calls":7,"redis_duration_s":0.001696,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001265,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000431,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.066257,"completed_at":"2026-08-20T05:57:12.152Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010207,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2340gitlab # [ 256.106387] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.154Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2c8abd368f8b226f7767e2bc","created_at":"2026-08-20T05:57:11.963Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.966Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2c8abd368f8b226f7767e2bc: start","job_status":"start","queue_duration_s":0.187541,"scheduling_latency_s":0.187572}2341gitlab # [ 256.146573] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.211Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2c8abd368f8b226f7767e2bc","created_at":"2026-08-20T05:57:11.963Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.966Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2c8abd368f8b226f7767e2bc: done: 0.05779 sec","job_status":"done","queue_duration_s":0.187541,"scheduling_latency_s":0.187572,"redis_calls":7,"redis_duration_s":0.001905,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00143,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000475,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.035,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.05779,"completed_at":"2026-08-20T05:57:12.211Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034547,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2342gitlab # [ 256.183209] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.249Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"435534a16f0eed271889db4b","created_at":"2026-08-20T05:57:11.973Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.975Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-435534a16f0eed271889db4b: start","job_status":"start","queue_duration_s":0.273681,"scheduling_latency_s":0.273712}2343gitlab # [ 256.196666] gitaly[898]: time="2026-08-20T05:57:12.254Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXCTHKTZ74MRWR4CBEZBF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:42.252" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:12.253" grpc.time_ms=1.327 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2344gitlab # [ 256.214794] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.280Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"435534a16f0eed271889db4b","created_at":"2026-08-20T05:57:11.973Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.975Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-435534a16f0eed271889db4b: done: 0.031626 sec","job_status":"done","queue_duration_s":0.273681,"scheduling_latency_s":0.273712,"redis_calls":7,"redis_duration_s":0.001966,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001419,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000547,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031626,"completed_at":"2026-08-20T05:57:12.280Z","load_balancing_strategy":"primary","db_duration_s":0.004378,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2345gitlab # [ 256.216428] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.281Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"39241a1cd845f78cfc375228","created_at":"2026-08-20T05:57:11.982Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.985Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-39241a1cd845f78cfc375228: start","job_status":"start","queue_duration_s":0.296548,"scheduling_latency_s":0.296582}2346gitlab # [ 256.241591] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.307Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"39241a1cd845f78cfc375228","created_at":"2026-08-20T05:57:11.982Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.985Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-39241a1cd845f78cfc375228: done: 0.025656 sec","job_status":"done","queue_duration_s":0.296548,"scheduling_latency_s":0.296582,"redis_calls":10,"redis_duration_s":0.0021750000000000003,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000631,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025656,"completed_at":"2026-08-20T05:57:12.307Z","load_balancing_strategy":"primary","db_duration_s":0.004878,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2347gitlab # [ 256.262971] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.308Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"fcb42e3debc29594c6f05aeb","created_at":"2026-08-20T05:57:11.985Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.987Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-fcb42e3debc29594c6f05aeb: start","job_status":"start","queue_duration_s":0.321703,"scheduling_latency_s":0.32172}2348gitlab # [ 256.298582] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.329Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"fcb42e3debc29594c6f05aeb","created_at":"2026-08-20T05:57:11.985Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.987Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-fcb42e3debc29594c6f05aeb: done: 0.02093 sec","job_status":"done","queue_duration_s":0.321703,"scheduling_latency_s":0.32172,"redis_calls":7,"redis_duration_s":0.001651,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001212,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02093,"completed_at":"2026-08-20T05:57:12.329Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004732,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2349gitlab # [ 256.311767] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.331Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"12eb329a30e5710c16d1a9a2","created_at":"2026-08-20T05:57:11.987Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.988Z","job_size_bytes":19,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-12eb329a30e5710c16d1a9a2: start","job_status":"start","queue_duration_s":0.34232,"scheduling_latency_s":0.342337}2350gitlab # [ 256.350231] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.354Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"12eb329a30e5710c16d1a9a2","created_at":"2026-08-20T05:57:11.987Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.988Z","job_size_bytes":19,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-12eb329a30e5710c16d1a9a2: done: 0.023248 sec","job_status":"done","queue_duration_s":0.34232,"scheduling_latency_s":0.342337,"redis_calls":8,"redis_duration_s":0.004739,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001871,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002868,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023248,"completed_at":"2026-08-20T05:57:12.354Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004676,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2351gitlab # [ 256.359798] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.355Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"4f2d848109bf6faaf1d175e1","created_at":"2026-08-20T05:57:11.989Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.990Z","job_size_bytes":66,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-4f2d848109bf6faaf1d175e1: start","job_status":"start","queue_duration_s":0.365267,"scheduling_latency_s":0.365284}2352gitlab # [ 256.401562] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.373Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"4f2d848109bf6faaf1d175e1","created_at":"2026-08-20T05:57:11.989Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.990Z","job_size_bytes":66,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-4f2d848109bf6faaf1d175e1: done: 0.01814 sec","job_status":"done","queue_duration_s":0.365267,"scheduling_latency_s":0.365284,"redis_calls":7,"redis_duration_s":0.001627,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000432,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01814,"completed_at":"2026-08-20T05:57:12.373Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003075,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2353gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d3f019c6d0414710c10bcfe109e2734c66b33866/statuses2354gitlab # [ 256.409805] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.375Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"45fcf87cbb65dfbfaf916cf0","created_at":"2026-08-20T05:57:11.991Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.992Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-45fcf87cbb65dfbfaf916cf0: start","job_status":"start","queue_duration_s":0.383068,"scheduling_latency_s":0.383085}2355gitlab # [ 256.424228] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.449Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"45fcf87cbb65dfbfaf916cf0","created_at":"2026-08-20T05:57:11.991Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.992Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-45fcf87cbb65dfbfaf916cf0: done: 0.074047 sec","job_status":"done","queue_duration_s":0.383068,"scheduling_latency_s":0.383085,"redis_calls":7,"redis_duration_s":0.001496,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001107,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000389,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.074047,"completed_at":"2026-08-20T05:57:12.449Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.050127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2356gitlab # [ 256.463346] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.451Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"b965b9f9a2f46e07f54034f7","created_at":"2026-08-20T05:57:11.995Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.996Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-b965b9f9a2f46e07f54034f7: start","job_status":"start","queue_duration_s":0.455078,"scheduling_latency_s":0.4551}2357gitlab # [ 256.498368] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.470Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"b965b9f9a2f46e07f54034f7","created_at":"2026-08-20T05:57:11.995Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.996Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-b965b9f9a2f46e07f54034f7: done: 0.019328 sec","job_status":"done","queue_duration_s":0.455078,"scheduling_latency_s":0.4551,"redis_calls":7,"redis_duration_s":0.001045,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019328,"completed_at":"2026-08-20T05:57:12.470Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003853,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2358gitlab # [ 256.504782] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.471Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"301f7f752f053543e9cc323e","created_at":"2026-08-20T05:57:11.996Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.997Z","job_size_bytes":6,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-301f7f752f053543e9cc323e: start","job_status":"start","queue_duration_s":0.474493,"scheduling_latency_s":0.474509}2359gitlab # [ 256.541802] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.481Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"301f7f752f053543e9cc323e","created_at":"2026-08-20T05:57:11.996Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.997Z","job_size_bytes":6,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-301f7f752f053543e9cc323e: done: 0.009738 sec","job_status":"done","queue_duration_s":0.474493,"scheduling_latency_s":0.474509,"redis_calls":7,"redis_duration_s":0.000974,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009738,"completed_at":"2026-08-20T05:57:12.481Z","load_balancing_strategy":"primary","db_duration_s":0.000262,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2360gitlab # [ 256.551988] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.482Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"f9087495e5f9a88a37f249b9","created_at":"2026-08-20T05:57:11.997Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.998Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f9087495e5f9a88a37f249b9: start","job_status":"start","queue_duration_s":0.483984,"scheduling_latency_s":0.483999}2361gitlab # [ 256.565589] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.497Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"f9087495e5f9a88a37f249b9","created_at":"2026-08-20T05:57:11.997Z","trace_propagation_headers":{"sentry-trace":"9e5949f065814267a339bf476d94a5eb-d55377979ff34f2b","baggage":"sentry-trace_id=9e5949f065814267a339bf476d94a5eb,sentry-release=Unknown"},"correlation_id":"01M0EVXC83P32T9TWG8692BP2R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:11.998Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f9087495e5f9a88a37f249b9: done: 0.01526 sec","job_status":"done","queue_duration_s":0.483984,"scheduling_latency_s":0.483999,"redis_calls":7,"redis_duration_s":0.000981,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000723,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01526,"completed_at":"2026-08-20T05:57:12.497Z","load_balancing_strategy":"primary","db_duration_s":0.002117,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2362gitlab # [ 256.600802] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.498Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f99598cc387ba7acf72db762","created_at":"2026-08-20T05:57:12.048Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-a6d87ef94e7d47b5","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:12.101Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f99598cc387ba7acf72db762: start","job_status":"start","queue_duration_s":0.39743,"scheduling_latency_s":0.397444}2363gitlab # [ 256.634784] gitaly[898]: time="2026-08-20T05:57:12.701Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXD8S5M9R8W2Q4Z8JBS6E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:42.696" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:12.697" grpc.time_ms=3.318 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2364gitlab # [ 256.660310] gitaly[898]: time="2026-08-20T05:57:12.726Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=40 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=40 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXCFT85J6QSW4RHFK93SQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:57:42.481" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:12.682" grpc.time_ms=43.593 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2365gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d3f019c6d0414710c10bcfe109e2734c66b33866/statuses, in 0.22 seconds)2366gitlab # [ 256.671458] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d3f019c6d0414710c10bcfe109e2734c66b33866/statuses HTTP/1.1" 200 1295 "" "curl/8.21.0" 1312367gitlab # [ 256.684073] gitaly[898]: time="2026-08-20T05:57:12.750Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXCTHKTZ74MRWR4CBEZBF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:22.094" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:12.744" grpc.time_ms=5.845 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2368gitlab # [ 256.699921] gitaly[898]: time="2026-08-20T05:57:12.766Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXCFT85J6QSW4RHFK93SQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:42.565" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:12.765" grpc.time_ms=0.66 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2369gitlab # [ 256.721359] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.787Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b4cd8124930316106f2888d4","created_at":"2026-08-20T05:57:12.785Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-879c3d6ad32b4548","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"f99598cc387ba7acf72db762","job_size_bytes":3,"pid":2609,"job_status":"deduplicated","message":"PipelineProcessWorker JID-b4cd8124930316106f2888d4: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2370gitlab # [ 256.734837] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.800Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f99598cc387ba7acf72db762","created_at":"2026-08-20T05:57:12.048Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-a6d87ef94e7d47b5","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:12.101Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2609,"job_status":"rescheduled","message":"PipelineProcessWorker JID-f99598cc387ba7acf72db762: rescheduled"}2371gitlab # [ 256.738510] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d3f019c6d0414710c10bcfe109e2734c66b33866 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 6592372gitlab # [ 256.739670] nixbot[2614]: {"ts": "2026-08-20T05:57:12.805Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d3f019c6d0414710c10bcfe109e2734c66b33866 \"HTTP/1.1 201 Created\""}2373gitlab # [ 256.756387] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.822Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f99598cc387ba7acf72db762","created_at":"2026-08-20T05:57:12.048Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-a6d87ef94e7d47b5","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:12.101Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f99598cc387ba7acf72db762: done: 0.323598 sec","job_status":"done","queue_duration_s":0.39743,"scheduling_latency_s":0.397444,"gitaly_calls":2,"gitaly_duration_s":0.058538,"redis_calls":40,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.082964,"redis_read_bytes":163,"redis_write_bytes":6868,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000872,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000791,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":4,"redis_queues_duration_s":0.000554,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2219,"redis_queues_metadata_calls":11,"redis_queues_metadata_duration_s":0.030565,"redis_queues_metadata_read_bytes":89,"redis_queues_metadata_write_bytes":1432,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.047936,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000431,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.086531,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.266635564,"duration_s":0.323598,"completed_at":"2026-08-20T05:57:12.822Z","load_balancing_strategy":"primary","db_duration_s":0.044631,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2374gitlab # [ 256.762168] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.824Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"ea63733ff284f245bae597d2","created_at":"2026-08-20T05:57:12.600Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-879c3d6ad32b4548","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:12.658Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ea63733ff284f245bae597d2: start","job_status":"start","queue_duration_s":0.165395,"scheduling_latency_s":0.165433}2375gitlab # [ 256.806926] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.854Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"ea63733ff284f245bae597d2","created_at":"2026-08-20T05:57:12.600Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-879c3d6ad32b4548","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:12.658Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ea63733ff284f245bae597d2: done: 0.030251 sec","job_status":"done","queue_duration_s":0.165395,"scheduling_latency_s":0.165433,"redis_calls":7,"redis_duration_s":0.001152,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00085,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030251,"completed_at":"2026-08-20T05:57:12.854Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003562,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2376gitlab # [ 256.809162] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:12.855Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"2ebf4fe795289bb6bea420be","created_at":"2026-08-20T05:57:12.801Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-879c3d6ad32b4548","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:12.818Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2ebf4fe795289bb6bea420be: start","job_status":"start","queue_duration_s":0.036814,"scheduling_latency_s":0.036831}2377gitlab # [ 256.889724] gitaly[898]: time="2026-08-20T05:57:12.955Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVXCFT85J6QSW4RHFK93SQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:12.955" grpc.time_ms=0.338 pid=898 span.kind=server system=grpc2378gitlab # [ 256.900772] nix-daemon[2819]: accepted connection from pid 3507, user nixbot2379gitlab # [ 256.913625] gitaly[898]: time="2026-08-20T05:57:12.979Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVXCFT85J6QSW4RHFK93SQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:12.979" grpc.time_ms=0.319 pid=898 span.kind=server system=grpc2380gitlab # [ 256.946230] gitaly[898]: time="2026-08-20T05:57:13.012Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVXCFT85J6QSW4RHFK93SQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:13.012" grpc.time_ms=0.268 pid=898 span.kind=server system=grpc2381gitlab # [ 256.961169] gitaly[898]: time="2026-08-20T05:57:13.027Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXCFT85J6QSW4RHFK93SQ diskcache=f2099955-8536-4aa7-b95b-22892e6a6fd6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:42.733" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:12.933" pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2382gitlab # [ 256.961657] gitaly[898]: time="2026-08-20T05:57:13.027Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=66 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7398 command.oublock=0 command.real_time_ms=87 command.spawn_token_fork_ms=0 command.system_time_ms=41 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXCFT85J6QSW4RHFK93SQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:57:42.733" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:12.933" grpc.time_ms=93.726 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2383gitlab # [ 256.988232] gitaly[898]: time="2026-08-20T05:57:13.054Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXDNHEG6TJFVKBV8V66TR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:13.049" grpc.time_ms=5.333 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc2384gitlab # [ 256.988922] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 452385gitlab # [ 257.025958] gitaly[898]: time="2026-08-20T05:57:13.092Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVXCFT85J6QSW4RHFK93SQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:57:43.091" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:13.091" grpc.time_ms=0.669 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2386gitlab # [ 257.035964] gitaly[898]: time="2026-08-20T05:57:13.102Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXDQ08AXKZ55X0472PNTZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:13.092" pid=898 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2387gitlab # [ 257.036671] gitaly[898]: time="2026-08-20T05:57:13.102Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXDQ08AXKZ55X0472PNTZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:13.092" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc2388gitlab # [ 257.037582] gitlab-workhorse[822]: time="2026-08-20T05:57:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672389gitlab # [ 257.037982] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 462390gitlab # [ 257.038611] gitaly[898]: time="2026-08-20T05:57:13.102Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXDQ08AXKZ55X0472PNTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:13.092" grpc.time_ms=9.818 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc2391gitlab # [ 257.067642] gitaly[898]: time="2026-08-20T05:57:13.133Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXCFT85J6QSW4RHFK93SQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:43.132" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:13.133" grpc.time_ms=0.593 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2392gitlab # [ 257.116634] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:13.182Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"2ebf4fe795289bb6bea420be","created_at":"2026-08-20T05:57:12.801Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-879c3d6ad32b4548","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:12.818Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2ebf4fe795289bb6bea420be: done: 0.326998 sec","job_status":"done","queue_duration_s":0.036814,"scheduling_latency_s":0.036831,"gitaly_calls":3,"gitaly_duration_s":0.101306,"redis_calls":73,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.034804,"redis_read_bytes":154,"redis_write_bytes":20036,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000762,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001065,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":23,"redis_queues_duration_s":0.002966,"redis_queues_read_bytes":25,"redis_queues_write_bytes":13381,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.02585,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3094,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000169,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000424,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002806,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.072,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.051,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.10421,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.265746065,"duration_s":0.326998,"completed_at":"2026-08-20T05:57:13.182Z","load_balancing_strategy":"primary","db_duration_s":0.075006,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2393gitlab # [ 257.143297] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:13.208Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"4d3f6bb8c7e7ff7d842e09c3","created_at":"2026-08-20T05:57:12.926Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-c798107fdd114b61","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:12.929Z","job_size_bytes":23,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-4d3f6bb8c7e7ff7d842e09c3: start","job_status":"start","queue_duration_s":0.279818,"scheduling_latency_s":0.279853}2394gitlab # [ 257.173145] nix-daemon[2819]: accepted connection from pid 3556, user nixbot2395gitlab # [ 257.271505] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:13.336Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"4d3f6bb8c7e7ff7d842e09c3","created_at":"2026-08-20T05:57:12.926Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-c798107fdd114b61","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:12.929Z","job_size_bytes":23,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-4d3f6bb8c7e7ff7d842e09c3: done: 0.127954 sec","job_status":"done","queue_duration_s":0.279818,"scheduling_latency_s":0.279853,"redis_calls":7,"redis_duration_s":0.003035,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001643,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001392,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.069,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.127954,"completed_at":"2026-08-20T05:57:13.336Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.073215,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2396gitlab # [ 257.313031] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:13.341Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"674ba2b08bf5b60ac9394904","created_at":"2026-08-20T05:57:13.032Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-c798107fdd114b61","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.034Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-674ba2b08bf5b60ac9394904: start","job_status":"start","queue_duration_s":0.307176,"scheduling_latency_s":0.307204}2397gitlab # [ 257.348461] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:13.414Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"674ba2b08bf5b60ac9394904","created_at":"2026-08-20T05:57:13.032Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-c798107fdd114b61","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.034Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-674ba2b08bf5b60ac9394904: done: 0.072668 sec","job_status":"done","queue_duration_s":0.307176,"scheduling_latency_s":0.307204,"redis_calls":7,"redis_duration_s":0.003297,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001794,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001503,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.072668,"completed_at":"2026-08-20T05:57:13.414Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008793,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2398gitlab # [ 257.389331] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:13.455Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"87c691a7764e00ffe658c7f5","created_at":"2026-08-20T05:57:13.039Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-c798107fdd114b61","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.041Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-87c691a7764e00ffe658c7f5: start","job_status":"start","queue_duration_s":0.413368,"scheduling_latency_s":0.413413}2399gitlab # [ 257.488097] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:13.553Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"87c691a7764e00ffe658c7f5","created_at":"2026-08-20T05:57:13.039Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-c798107fdd114b61","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.041Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-87c691a7764e00ffe658c7f5: done: 0.098506 sec","job_status":"done","queue_duration_s":0.413368,"scheduling_latency_s":0.413413,"redis_calls":7,"redis_duration_s":0.029529,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.027105,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002424,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.098506,"completed_at":"2026-08-20T05:57:13.553Z","load_balancing_strategy":"primary","db_duration_s":0.014549,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2400gitlab # [ 257.554146] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:13.619Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"92ce61d87879cc1b2b567f82","created_at":"2026-08-20T05:57:13.048Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-c798107fdd114b61","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.050Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-92ce61d87879cc1b2b567f82: start","job_status":"start","queue_duration_s":0.569516,"scheduling_latency_s":0.569566}2401gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d3f019c6d0414710c10bcfe109e2734c66b33866/statuses2402gitlab # [ 257.630395] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:13.695Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"92ce61d87879cc1b2b567f82","created_at":"2026-08-20T05:57:13.048Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-c798107fdd114b61","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.050Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-92ce61d87879cc1b2b567f82: done: 0.076257 sec","job_status":"done","queue_duration_s":0.569516,"scheduling_latency_s":0.569566,"redis_calls":10,"redis_duration_s":0.006834,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002794,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000914,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003126,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.076257,"completed_at":"2026-08-20T05:57:13.695Z","load_balancing_strategy":"primary","db_duration_s":0.017904,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2403gitlab # [ 257.692109] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:13.757Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3a7709316cca57f75f0bea95","created_at":"2026-08-20T05:57:13.050Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-c798107fdd114b61","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.053Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3a7709316cca57f75f0bea95: start","job_status":"start","queue_duration_s":0.704742,"scheduling_latency_s":0.704788}2404gitlab # [ 257.749308] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:13.813Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3a7709316cca57f75f0bea95","created_at":"2026-08-20T05:57:13.050Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-c798107fdd114b61","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.053Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3a7709316cca57f75f0bea95: done: 0.056075 sec","job_status":"done","queue_duration_s":0.704742,"scheduling_latency_s":0.704788,"redis_calls":7,"redis_duration_s":0.002206,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001605,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000601,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056075,"completed_at":"2026-08-20T05:57:13.813Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009538,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2405gitlab # [ 257.779629] gitaly[898]: time="2026-08-20T05:57:13.845Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVXEDWKCD9PJY9SEKPRN76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:43.844" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:13.844" grpc.time_ms=0.8 pid=898 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2406gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d3f019c6d0414710c10bcfe109e2734c66b33866/statuses, in 0.14 seconds)2407(finished: subtest: eval and build post commit statuses, in 2.45 seconds)2408(finished: run the VM test script, in 319.95 seconds)2409gitlab # [ 257.803053] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:13.868Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"134bd863d2d689e53bd9e1d6","created_at":"2026-08-20T05:57:13.053Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-c798107fdd114b61","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.068Z","job_size_bytes":19,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-134bd863d2d689e53bd9e1d6: start","job_status":"start","queue_duration_s":0.799839,"scheduling_latency_s":0.799903}2410gitlab # [ 257.808163] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d3f019c6d0414710c10bcfe109e2734c66b33866/statuses HTTP/1.1" 200 1316 "" "curl/8.21.0" 842411gitlab # [ 257.832175] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:13.896Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"134bd863d2d689e53bd9e1d6","created_at":"2026-08-20T05:57:13.053Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-c798107fdd114b61","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.068Z","job_size_bytes":19,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-134bd863d2d689e53bd9e1d6: done: 0.028323 sec","job_status":"done","queue_duration_s":0.799839,"scheduling_latency_s":0.799903,"redis_calls":8,"redis_duration_s":0.00211,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001596,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028323,"completed_at":"2026-08-20T05:57:13.896Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006775,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2412gitlab # [ 257.833207] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:13.898Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"65b90f915d1efca708a0e787","created_at":"2026-08-20T05:57:13.069Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-c798107fdd114b61","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.073Z","job_size_bytes":66,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-65b90f915d1efca708a0e787: start","job_status":"start","queue_duration_s":0.824852,"scheduling_latency_s":0.82487}2413gitlab # [ 257.883350] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:13.913Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"65b90f915d1efca708a0e787","created_at":"2026-08-20T05:57:13.069Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-c798107fdd114b61","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.073Z","job_size_bytes":66,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-65b90f915d1efca708a0e787: done: 0.015684 sec","job_status":"done","queue_duration_s":0.824852,"scheduling_latency_s":0.82487,"redis_calls":7,"redis_duration_s":0.001013,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000294,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015684,"completed_at":"2026-08-20T05:57:13.913Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002947,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2414gitlab # [ 257.884126] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:13.914Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"e4d4a12058840fdd95b8647a","created_at":"2026-08-20T05:57:13.074Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-c798107fdd114b61","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.075Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-e4d4a12058840fdd95b8647a: start","job_status":"start","queue_duration_s":0.839168,"scheduling_latency_s":0.839182}2415test script finished in 320.09s2416cleanup2417kill QemuMachine (pid 46)2418gitlab # [ 257.921801] sidekiq-cluster[2609]: {"severity":"INFO","time":"2026-08-20T05:57:13.939Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"e4d4a12058840fdd95b8647a","created_at":"2026-08-20T05:57:13.074Z","trace_propagation_headers":{"sentry-trace":"c132bde706dc47f186bb19b9b19aa833-c798107fdd114b61","baggage":"sentry-trace_id=c132bde706dc47f186bb19b9b19aa833,sentry-release=Unknown"},"correlation_id":"01M0EVXCFT85J6QSW4RHFK93SQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.075Z","job_size_bytes":3,"pid":2609,"sidekiq_tid":"m82t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-e4d4a12058840fdd95b8647a: done: 0.025261 sec","job_status":"done","queue_duration_s":0.839168,"scheduling_latency_s":0.839182,"redis_calls":7,"redis_duration_s":0.001022,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014938,"worker_id":"sidekiq_0","rate_liqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2419gitlab # m2420(finished: cleanup, in 1.80 seconds)2421additionally exposed symbols:2422 gitlab,2423 vlan1,2424 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2425[]2426[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-20T05:56:12.672Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2427[]2428[]2429[]2430[]2431[]2432[]2433[]2434[]2435[]2436[]2437[]2438[]2439[]2440[]2441[]2442[]2443[]2444[]2445[]2446[]2447[]2448[]2449[]2450[]2451[]2452[]2453[]2454[]2455[]2456[]2457[]2458[]2459[]2460[]2461[]2462[]2463[]2464[]2465[]2466[]2467[]2468[]2469[]2470[]2471[]2472[]2473[]2474[]2475[]2476[]2477[]2478[]2479[]2480[]2481[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'd3f019c6d0414710c10bcfe109e2734c66b33866', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-20T05:57:09.904037Z', 'started_at': '2026-08-20T05:57:10.233823Z', 'finished_at': None}]2482[{'id': 5, 'sha': 'd3f019c6d0414710c10bcfe109e2734c66b33866', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T05:57:10.215Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2483[{'id': 5, 'sha': 'd3f019c6d0414710c10bcfe109e2734c66b33866', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-20T05:57:10.215Z', 'started_at': None, 'finished_at': '2026-08-20T05:57:11.718Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'd3f019c6d0414710c10bcfe109e2734c66b33866', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-08-20T05:57:12.043Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2484[{'id': 5, 'sha': 'd3f019c6d0414710c10bcfe109e2734c66b33866', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-20T05:57:10.215Z', 'started_at': None, 'finished_at': '2026-08-20T05:57:11.718Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'd3f019c6d0414710c10bcfe109e2734c66b33866', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-20T05:57:12.043Z', 'started_at': None, 'finished_at': '2026-08-20T05:57:12.770Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]