tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.z0iG9kmGTR', fmt=raw size=1073741824 (finished: start all VMs, in 35.90 seconds) gitlab # mke2fs 1.47.4 (6-Mar-2025) gitlab: waiting for unit setup-gitlab.service gitlab # Discarding device blocks: 0/262144 done gitlab: waiting for the VM to finish booting gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab # Filesystem UUID: 6566b48e-7da9-4eb7-aee4-cbc272c776b4 gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)... gitlab # gitlab # gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)... gitlab # gitlab # gitlab # Booting from ROM... gitlab # Probing EDD (edd=off to disable)... ok gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rfdaqkmfjlz0cvmb4v3ihvhrhbkx2b5n-nixos-system-gitlab-test/init regInfo=/nix/store/n3awyg6gwcbf98pxamlyglp013sca88m-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.000000] BIOS-provided physical RAM map: gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved gitlab # [ 0.000000] NX (Execute Disable) protection: active gitlab # [ 0.000000] APIC: Static calls initialized gitlab # [ 0.000000] SMBIOS 2.8 present. gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 gitlab # [ 0.000000] DMI: Memory slots populated: 1/1 gitlab # [ 0.000000] Hypervisor detected: KVM gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 gitlab # [ 0.000000] kvm-clock: using sched offset of 504371083 cycles gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor gitlab # [ 0.000811] last_pfn = 0x1c0000 max_arch_pfn = 0x10000000000 gitlab # [ 0.000848] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs gitlab # [ 0.000851] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT gitlab # [ 0.000903] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.002755] found SMP MP-table at [mem 0x000f5470-0x000f547f] gitlab # [ 0.002766] Using GB pages for direct mapping gitlab # [ 0.002903] RAMDISK: [mem 0xbe31c000-0xbffcffff] gitlab # [ 0.002910] ACPI: Early table checksum verification disabled gitlab # [ 0.002912] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) gitlab # [ 0.002916] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002919] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002925] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002927] ACPI: FACS 0x00000000BFFE0000 000040 gitlab # [ 0.002929] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002930] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002932] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002933] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2] gitlab # [ 0.002934] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e] gitlab # [ 0.002935] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] gitlab # [ 0.002936] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482] gitlab # [ 0.002936] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba] gitlab # [ 0.002937] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2] gitlab # [ 0.003409] No NUMA configuration found gitlab # [ 0.003411] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff] gitlab # [ 0.003414] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff] gitlab # [ 0.005836] Zone ranges: gitlab # [ 0.005836] DMA [mem 0x0000000000001000-0x0000000000ffffff] gitlab # [ 0.005838] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] gitlab # [ 0.005839] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005840] Device empty gitlab # [ 0.005841] Movable zone start for each node gitlab # [ 0.005841] Early memory node ranges gitlab # [ 0.005842] node 0: [mem 0x0000000000001000-0x000000000009efff] gitlab # [ 0.005843] node 0: [mem 0x0000000000100000-0x00000000bffd7fff] gitlab # [ 0.005844] node 0: [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005845] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff] gitlab # [ 0.005862] On node 0, zone DMA: 1 pages in unavailable ranges gitlab # [ 0.006123] On node 0, zone DMA: 97 pages in unavailable ranges gitlab # [ 0.112648] On node 0, zone Normal: 40 pages in unavailable ranges gitlab # [ 0.113661] ACPI: PM-Timer IO Port: 0x608 gitlab # [ 0.113678] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) gitlab # [ 0.113714] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 gitlab # [ 0.113717] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) gitlab # [ 0.113718] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) gitlab # [ 0.113719] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) gitlab # [ 0.113720] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) gitlab # [ 0.113721] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) gitlab # [ 0.113724] ACPI: Using ACPI (MADT) for SMP configuration information gitlab # [ 0.113725] ACPI: HPET id: 0x8086a201 base: 0xfed00000 gitlab # [ 0.113731] TSC deadline timer available gitlab # [ 0.113736] CPU topo: Max. logical packages: 1 gitlab # [ 0.113736] CPU topo: Max. logical dies: 1 gitlab # [ 0.113737] CPU topo: Max. dies per package: 1 gitlab # [ 0.113740] CPU topo: Max. threads per core: 1 gitlab # [ 0.113741] CPU topo: Num. cores per package: 4 gitlab # [ 0.113741] CPU topo: Num. threads per package: 4 gitlab # [ 0.113742] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs gitlab # [ 0.113766] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() gitlab # [ 0.113784] kvm-guest: KVM setup pv remote TLB flush gitlab # [ 0.113788] kvm-guest: setup PV sched yield gitlab # [ 0.113809] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] gitlab # [ 0.113810] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] gitlab # [ 0.113811] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff] gitlab # [ 0.113813] [mem 0xc0000000-0xfeffbfff] available for PCI devices gitlab # [ 0.113814] Booting paravirtualized kernel on KVM gitlab # [ 0.113818] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns gitlab # [ 0.118413] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 gitlab # [ 0.120612] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 gitlab # [ 0.120661] kvm-guest: PV spinlocks enabled gitlab # [ 0.120663] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) gitlab # [ 0.120665] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rfdaqkmfjlz0cvmb4v3ihvhrhbkx2b5n-nixos-system-gitlab-test/init regInfo=/nix/store/n3awyg6gwcbf98pxamlyglp013sca88m-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.120758] Unknown kernel command line parameters "regInfo=/nix/store/n3awyg6gwcbf98pxamlyglp013sca88m-closure-info/registration", will be passed to user space. gitlab # [ 0.120771] random: crng init done gitlab # [ 0.120771] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes gitlab # [ 0.129458] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.133894] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.133970] software IO TLB: area num 4. gitlab # [ 0.206555] Fallback order for Node 0: 0 gitlab # [ 0.206563] Built 1 zonelists, mobility grouping on. Total pages: 1572726 gitlab # [ 0.206564] Policy zone: Normal gitlab # [ 0.209059] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.218069] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.231497] allocated 12582912 bytes of page_ext gitlab # [ 0.241237] ftrace: allocating 48717 entries in 192 pages gitlab # [ 0.241238] ftrace: allocated 192 pages with 2 groups gitlab # [ 0.242077] Dynamic Preempt: lazy gitlab # [ 0.242238] rcu: Preemptible hierarchical RCU implementation. gitlab # [ 0.242239] rcu: RCU event tracing is enabled. gitlab # [ 0.242240] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.242241] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.242242] Rude variant of Tasks RCU enabled. gitlab # [ 0.242242] Tracing variant of Tasks RCU enabled. gitlab # [ 0.242242] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. gitlab # [ 0.242243] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.242262] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.242264] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.242265] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.246579] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 gitlab # [ 0.246846] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.246854] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns gitlab # [ 0.246961] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.254260] Console: colour VGA+ 80x25 gitlab # [ 0.254264] printk: legacy console [tty0] enabled gitlab # [ 0.298606] printk: legacy console [ttyS0] enabled gitlab # [ 0.498301] ACPI: Core revision 20250807 gitlab # [ 0.499881] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns gitlab # [ 0.502639] APIC: Switch to symmetric I/O mode setup gitlab # [ 0.504399] x2apic enabled gitlab # [ 0.505656] APIC: Switched APIC routing to: physical x2apic gitlab # [ 0.507342] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() gitlab # [ 0.509552] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() gitlab # [ 0.512297] kvm-guest: setup PV IPIs gitlab # [ 0.514618] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 gitlab # [ 0.516448] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns gitlab # [ 0.519532] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008) gitlab # [ 0.521647] x86/cpu: User Mode Instruction Prevention (UMIP) activated gitlab # [ 0.522675] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 gitlab # [ 0.524531] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 gitlab # [ 0.525536] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto gitlab # [ 0.526531] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl gitlab # [ 0.527531] Transient Scheduler Attacks: Mitigation: Clear CPU buffers gitlab # [ 0.529530] Spectre V2 : Mitigation: Enhanced / Automatic IBRS gitlab # [ 0.531531] Speculative Return Stack Overflow: Mitigation: Safe RET gitlab # [ 0.532531] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization gitlab # [ 0.533539] Spectre V2 : Enabling IBPB for BPF gitlab # [ 0.534532] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier gitlab # [ 0.535532] active return thunk: srso_alias_return_thunk gitlab # [ 0.536560] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' gitlab # [ 0.538531] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' gitlab # [ 0.540531] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' gitlab # [ 0.542530] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' gitlab # [ 0.543531] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' gitlab # [ 0.544530] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' gitlab # [ 0.545531] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' gitlab # [ 0.546531] x86/fpu: Supporting XSAVE feature 0x800: 'Control-flow User registers' gitlab # [ 0.548531] x86/fpu: Supporting XSAVE feature 0x1000: 'Control-flow Kernel registers (KVM only)' gitlab # [ 0.550531] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 gitlab # [ 0.551530] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 gitlab # [ 0.552530] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 gitlab # [ 0.553531] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 gitlab # [ 0.554531] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 gitlab # [ 0.556531] x86/fpu: xstate_offset[11]: 2440, xstate_sizes[11]: 16 gitlab # [ 0.558531] x86/fpu: xstate_offset[12]: 2456, xstate_sizes[12]: 24 gitlab # [ 0.559530] x86/fpu: Enabled xstate features 0x1ae7, context size is 2480 bytes, using 'compacted' format. gitlab # [ 0.588652] Freeing SMP alternatives memory: 44K gitlab # [ 0.589533] pid_max: default: 32768 minimum: 301 gitlab # [ 0.591639] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.593554] landlock: Up and running. gitlab # [ 0.594531] Yama: becoming mindful. gitlab # [ 0.595738] LSM support for eBPF active gitlab # [ 0.597536] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.598674] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.601453] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) gitlab # [ 0.602105] Performance Events: Fam17h+ core perfctr, AMD PMU driver. gitlab # [ 0.602535] ... version: 2 gitlab # [ 0.603532] ... bit width: 48 gitlab # [ 0.604546] ... generic counters: 6 gitlab # [ 0.605532] ... generic bitmap: 000000000000003f gitlab # [ 0.606532] ... fixed-purpose counters: 0 gitlab # [ 0.607532] ... fixed-purpose bitmap: 0000000000000000 gitlab # [ 0.608532] ... value mask: 0000ffffffffffff gitlab # [ 0.609532] ... max period: 00007fffffffffff gitlab # [ 0.610532] ... global_ctrl mask: 000000000000003f gitlab # [ 0.611682] signal: max sigframe size: 3376 gitlab # [ 0.612621] rcu: Hierarchical SRCU implementation. gitlab # [ 0.613538] rcu: Max phase no-delay instances is 400. gitlab # [ 0.614722] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.620001] smp: Bringing up secondary CPUs ... gitlab # [ 0.620987] smpboot: x86: Booting SMP configuration: gitlab # [ 0.621535] .... node #0, CPUs: #1 #2 #3 gitlab # [ 0.625705] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.628536] smpboot: Total of 4 processors activated (19200.06 BogoMIPS) gitlab # [ 0.630124] Memory: 6011580K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved) gitlab # [ 0.632532] devtmpfs: initialized gitlab # [ 0.633761] x86/mm: Memory block size: 128MB gitlab # [ 0.637592] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.638616] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.639632] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.640912] PM: RTC time: 10:07:16, date: 2026-08-11 gitlab # [ 0.644638] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.646892] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.647586] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.649606] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.650546] audit: initializing netlink subsys (disabled) gitlab # [ 0.651760] audit: type=2000 audit(1786442836.306:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.651786] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.653533] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.654533] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.655533] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.656533] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.657552] cpuidle: using governor menu gitlab # [ 0.660782] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 gitlab # [ 0.661886] PCI: Using configuration type 1 for base access gitlab # [ 0.662533] PCI: Using configuration type 1 for extended access gitlab # [ 0.663732] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. gitlab # [ 0.666837] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.667533] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.668534] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.669532] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.674677] ACPI: Added _OSI(Module Device) gitlab # [ 0.678545] ACPI: Added _OSI(Processor Device) gitlab # [ 0.681542] ACPI: Added _OSI(Processor Aggregator Device) gitlab # [ 0.690599] ACPI: 1 ACPI AML tables successfully acquired and loaded gitlab # [ 0.701378] ACPI: Interpreter enabled gitlab # [ 0.704811] ACPI: PM: (supports S0 S3 S4 S5) gitlab # [ 0.707543] ACPI: Using IOAPIC for interrupt routing gitlab # [ 0.711926] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug gitlab # [ 0.718541] PCI: Using E820 reservations for host bridge windows gitlab # [ 0.723256] ACPI: Enabled 2 GPEs in block 00 to 0F gitlab # [ 0.738237] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) gitlab # [ 0.742551] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] gitlab # [ 0.748694] acpiphp: Slot [3] registered gitlab # [ 0.750637] acpiphp: Slot [4] registered gitlab # [ 0.753620] acpiphp: Slot [5] registered gitlab # [ 0.755664] acpiphp: Slot [6] registered gitlab # [ 0.757578] acpiphp: Slot [7] registered gitlab # [ 0.759576] acpiphp: Slot [8] registered gitlab # [ 0.760572] acpiphp: Slot [9] registered gitlab # [ 0.761589] acpiphp: Slot [10] registered gitlab # [ 0.762578] acpiphp: Slot [11] registered gitlab # [ 0.764585] acpiphp: Slot [12] registered gitlab # [ 0.765588] acpiphp: Slot [13] registered gitlab # [ 0.767625] acpiphp: Slot [14] registered gitlab # [ 0.768570] acpiphp: Slot [15] registered gitlab # [ 0.769568] acpiphp: Slot [16] registered gitlab # [ 0.771587] acpiphp: Slot [17] registered gitlab # [ 0.772567] acpiphp: Slot [18] registered gitlab # [ 0.773567] acpiphp: Slot [19] registered gitlab # [ 0.774568] acpiphp: Slot [20] registered gitlab # [ 0.776581] acpiphp: Slot [21] registered gitlab # [ 0.777568] acpiphp: Slot [22] registered gitlab # [ 0.778590] acpiphp: Slot [23] registered gitlab # [ 0.780567] acpiphp: Slot [24] registered gitlab # [ 0.781582] acpiphp: Slot [25] registered gitlab # [ 0.782568] acpiphp: Slot [26] registered gitlab # [ 0.783567] acpiphp: Slot [27] registered gitlab # [ 0.785567] acpiphp: Slot [28] registered gitlab # [ 0.786589] acpiphp: Slot [29] registered gitlab # [ 0.787569] acpiphp: Slot [30] registered gitlab # [ 0.788568] acpiphp: Slot [31] registered gitlab # [ 0.790610] PCI host bridge to bus 0000:00 gitlab # [ 0.791558] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] gitlab # [ 0.793535] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] gitlab # [ 0.795534] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] gitlab # [ 0.797534] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.799534] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.802537] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.804073] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.807593] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint gitlab # [ 0.811511] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint gitlab # [ 0.816615] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f] gitlab # [ 0.818599] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk gitlab # [ 0.820534] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk gitlab # [ 0.821534] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk gitlab # [ 0.823533] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk gitlab # [ 0.825866] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint gitlab # [ 0.830407] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f] gitlab # [ 0.832936] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint gitlab # [ 0.837161] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI gitlab # [ 0.842578] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB gitlab # [ 0.848702] pci 0000:00:01.3: quirk_piix4_acpi+0x0/0x180 took 10742 usecs gitlab # [ 0.854834] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint gitlab # [ 0.878750] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] gitlab # [ 0.883612] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] gitlab # [ 0.888642] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref] gitlab # [ 0.910900] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] gitlab # [ 0.914797] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.921569] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] gitlab # [ 0.922547] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] gitlab # [ 0.924587] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] gitlab # [ 0.926548] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] gitlab # [ 0.930984] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.936576] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f] gitlab # [ 0.938548] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] gitlab # [ 0.940586] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] gitlab # [ 0.944597] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.949857] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf] gitlab # [ 0.951558] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] gitlab # [ 0.953587] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] gitlab # [ 0.957705] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.964141] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df] gitlab # [ 0.965548] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] gitlab # [ 0.967586] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] gitlab # [ 0.971572] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.978570] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] gitlab # [ 0.980551] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] gitlab # [ 0.981650] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] gitlab # [ 0.990989] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 1.007579] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff] gitlab # [ 1.012587] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] gitlab # [ 1.016671] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] gitlab # [ 1.027699] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 1.040567] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff] gitlab # [ 1.043576] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] gitlab # [ 1.047631] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] gitlab # [ 1.049548] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref] gitlab # [ 1.053791] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 1.060585] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] gitlab # [ 1.061606] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] gitlab # [ 1.066547] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 1.071577] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f] gitlab # [ 1.073548] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] gitlab # [ 1.075586] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] gitlab # [ 1.079984] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 1.084569] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f] gitlab # [ 1.086548] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff] gitlab # [ 1.087586] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] gitlab # [ 1.097916] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 gitlab # [ 1.100783] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 gitlab # [ 1.102747] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 gitlab # [ 1.104738] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 gitlab # [ 1.106644] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 gitlab # [ 1.110599] iommu: Default domain type: Translated gitlab # [ 1.111533] iommu: DMA domain TLB invalidation policy: lazy mode gitlab # [ 1.114188] ACPI: bus type USB registered gitlab # [ 1.115676] usbcore: registered new interface driver usbfs gitlab # [ 1.117586] usbcore: registered new interface driver hub gitlab # [ 1.119571] usbcore: registered new device driver usb gitlab # [ 1.122201] NetLabel: Initializing gitlab # [ 1.123533] NetLabel: domain hash size = 128 gitlab # [ 1.124533] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO gitlab # [ 1.126616] NetLabel: unlabeled traffic allowed by default gitlab # [ 1.128548] PCI: Using ACPI for IRQ routing gitlab # [ 1.130751] pci 0000:00:02.0: vgaarb: setting as boot VGA device gitlab # [ 1.131528] pci 0000:00:02.0: vgaarb: bridge control possible gitlab # [ 1.131528] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none gitlab # [ 1.136539] vgaarb: loaded gitlab # [ 1.137687] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 gitlab # [ 1.138534] hpet0: 3 comparators, 64-bit 100.000000 MHz counter gitlab # [ 1.146650] clocksource: Switched to clocksource kvm-clock gitlab # [ 1.151428] VFS: Disk quotas dquot_6.6.0 gitlab # [ 1.152723] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 1.155244] pnp: PnP ACPI init gitlab # [ 1.157083] pnp: PnP ACPI: found 6 devices gitlab # [ 1.168156] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns gitlab # [ 1.174759] clocksource: Switched to clocksource acpi_pm gitlab # [ 1.179324] NET: Registered PF_INET protocol family gitlab # [ 1.186819] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 1.223221] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 1.225865] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 1.228281] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 1.233548] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 1.236210] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 1.242913] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 1.249480] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 1.255371] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 1.261409] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 1.265854] NET: Registered PF_XDP protocol family gitlab # [ 1.269628] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] gitlab # [ 1.274254] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] gitlab # [ 1.278859] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] gitlab # [ 1.283634] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] gitlab # [ 1.287650] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 1.292264] pci 0000:00:01.0: PIIX3: Enabling Passive Release gitlab # [ 1.295799] pci 0000:00:00.0: Limiting direct PCI/PCI transfers gitlab # [ 1.301555] ACPI: \_SB_.LNKD: Enabled at IRQ 11 gitlab # [ 1.305172] PCI: CLS 0 bytes, default 64 gitlab # [ 1.306599] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) gitlab # [ 1.307022] Trying to unpack rootfs image as initramfs... gitlab # [ 1.309107] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB) gitlab # [ 1.309365] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns gitlab # [ 1.348886] Initialise system trusted keyrings gitlab # [ 1.351162] workingset: timestamp_bits=40 max_order=21 bucket_order=0 gitlab # [ 1.381799] Key type asymmetric registered gitlab # [ 1.385119] Asymmetric key parser 'x509' registered gitlab # [ 1.389155] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) gitlab # [ 1.395338] io scheduler mq-deadline registered gitlab # [ 1.398948] io scheduler kyber registered gitlab # [ 1.409791] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 1.415525] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A gitlab # [ 1.426084] Linux agpgart interface v0.103 gitlab # [ 1.429783] ACPI: bus type drm_connector registered gitlab # [ 1.436808] usbcore: registered new interface driver usbserial_generic gitlab # [ 1.441615] usbserial: USB Serial support registered for generic gitlab # [ 1.446172] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. gitlab # [ 1.446172] Please enable it if your BIOS has the CPPC option. gitlab # [ 1.456074] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled gitlab # [ 1.462120] drop_monitor: Initializing network drop monitor service gitlab # [ 1.467187] NET: Registered PF_INET6 protocol family gitlab # [ 1.473262] Segment Routing with IPv6 gitlab # [ 1.476376] In-situ OAM (IOAM) with IPv6 gitlab # [ 1.482259] IPI shorthand broadcast: enabled gitlab # [ 1.495899] sched_clock: Marking stable (1235073054, 260673858)->(1576640618, -80893706) gitlab # [ 1.503637] registered taskstats version 1 gitlab # [ 1.507909] Loading compiled-in X.509 certificates gitlab # [ 1.528915] Demotion targets for Node 0: null gitlab # [ 1.530848] Key type .fscrypt registered gitlab # [ 1.532591] Key type fscrypt-provisioning registered gitlab # [ 1.534341] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 1.536033] ima: Allocated hash algorithm: sha1 gitlab # [ 1.537480] ima: No architecture policies found gitlab # [ 1.539443] PM: Magic number: 6:961:122 gitlab # [ 1.540886] acpi LNXSYBUS:00: hash matches gitlab # [ 1.543084] RAS: Correctable Errors collector initialized. gitlab # [ 1.548426] clk: Disabling unused clocks gitlab # [ 1.549717] PM: genpd: Disabling unused power domains gitlab # [ 1.616636] Freeing initrd memory: 29392K gitlab # [ 1.625164] Freeing unused decrypted memory: 2028K gitlab # [ 1.633787] Freeing unused kernel image (initmem) memory: 3640K gitlab # [ 1.638441] Write protecting the kernel read-only data: 32768k gitlab # [ 1.645608] Freeing unused kernel image (text/rodata gap) memory: 1220K gitlab # [ 1.652002] Freeing unused kernel image (rodata/data gap) memory: 760K gitlab # [ 1.712290] x86/mm: Checked W+X mappings: passed, no W+X pages found. gitlab # [ 1.714341] Run /init as init process gitlab # [ 1.729830] systemd[1]: Inserted module 'autofs4' gitlab # [ 1.758901] fuse: init (API version 7.45) gitlab # [ 1.769614] ACPI: \_SB_.LNKC: Enabled at IRQ 10 gitlab # [ 1.792188] ACPI: \_SB_.LNKA: Enabled at IRQ 10 gitlab # [ 1.797233] ACPI: \_SB_.LNKB: Enabled at IRQ 11 gitlab # [ 1.851412] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 2.188641] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 2.206632] systemd[1]: Detected virtualization kvm. gitlab # [ 2.210760] systemd[1]: Detected architecture x86-64. gitlab # [ 2.214627] systemd[1]: Running in initrd. gitlab # [ 2.218847] systemd[1]: Initializing machine ID from random generator. gitlab # [ 2.223979] systemd[1]: Hostname set to . gitlab # [ 2.450191] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 2.506153] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 2.522949] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 2.525016] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 2.527460] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 2.529547] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 2.531555] systemd[1]: Reached target Path Units. gitlab # [ 2.533165] systemd[1]: Reached target Slice Units. gitlab # [ 2.534794] systemd[1]: Reached target Swaps. gitlab # [ 2.536245] systemd[1]: Reached target Timer Units. gitlab # [ 2.538016] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 2.540188] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 2.542235] systemd[1]: Listening on Journal Sockets. gitlab # [ 2.544052] systemd[1]: Listening on udev Control Socket. gitlab # [ 2.545865] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 2.547556] systemd[1]: Reached target Socket Units. gitlab # [ 2.550802] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 2.554208] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 2.557426] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 2.562798] systemd[1]: Starting Journal Service... gitlab # [ 2.567803] systemd[1]: Starting Load Kernel Modules... gitlab # [ 2.569505] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 2.576105] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 2.584547] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 2.593812] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 2.599280] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 2.602451] systemd-journald[94]: Collecting audit messages is disabled. gitlab # [ 2.605576] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 2.608635] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config gitlab # [ 2.626487] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 2.630326] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 2.630857] netfs: FS-Cache loaded gitlab # [ 2.631788] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 2.636771] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 2.644402] 9pnet: Installing 9P2000 support gitlab # [ 2.648028] systemd[1]: Finished Load Kernel Modules. gitlab # [ 2.651629] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 2.657908] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 2.660372] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 2.664264] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 2.666885] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 2.669032] systemd[1]: Reached target Local File Systems. gitlab # [ 2.672133] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 2.675639] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 2.693364] systemd[1]: Started Journal Service. gitlab # [ 2.432853] systemd-modules-load[95]: Using 4 probe threads gitlab # [ 2.436616] systemd-modules-load[95]: Inserted module 'virtio_balloon' gitlab # [ 2.438661] systemd-modules-load[95]: Inserted module 'dm_mod' gitlab # [ 2.440562] systemd-modules-load[95]: Inserted module 'virtio_gpu' gitlab # [ 2.442508] systemd[1]: Starting Create System Files and Directories... gitlab # [ 2.444976] systemd-udevd[104]: Using default interface naming scheme 'v261'. gitlab # [ 2.459930] systemd[1]: Finished Create System Files and Directories. gitlab # [ 2.461844] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 2.503968] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.506669] systemd[1]: Reached target System Initialization. gitlab # [ 2.508834] systemd[1]: Reached target Basic System. gitlab # [ 2.886448] uhci_hcd 0000:00:01.2: UHCI Host Controller gitlab # [ 2.890949] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 gitlab # [ 2.893142] uhci_hcd 0000:00:01.2: detected 2 ports gitlab # [ 2.896136] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 2.898427] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140 gitlab # [ 2.900204] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 gitlab # [ 2.902143] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 gitlab # [ 2.903886] usb usb1: Product: UHCI Host Controller gitlab # [ 2.905246] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd gitlab # [ 2.906569] usb usb1: SerialNumber: 0000:00:01.2 gitlab # [ 2.908757] hub 1-0:1.0: USB hub found gitlab # [ 2.909747] hub 1-0:1.0: 2 ports detected gitlab # [ 2.920054] SCSI subsystem initialized gitlab # [ 2.920204] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 2.930113] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 2.960834] virtio_blk virtio5: [vdb] 11784496 512-byte logical blocks (6.03 GB/5.62 GiB) gitlab # [ 2.966955] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 gitlab # [ 2.970937] serio: i8042 KBD port at 0x60,0x64 irq 1 gitlab # [ 2.972280] serio: i8042 AUX port at 0x60,0x64 irq 12 gitlab # [ 2.980210] scsi host0: ata_piix gitlab # [ 2.981539] scsi host1: ata_piix gitlab # [ 2.982571] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0 gitlab # [ 2.984994] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0 gitlab # [ 2.738304] (udev-worker)[127]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.740889] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.749828] (udev-worker)[133]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.753775] (udev-worker)[133]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.766263] systemd-vconsole-setup[153]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.769753] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.772322] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.777947] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.779584] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.780949] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.807434] systemd-fsck[160]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.812132] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 3.131821] usb 1-1: new full-speed USB device number 2 using uhci_hcd gitlab # [ 3.148909] ata2: found unknown device (class 0) gitlab # [ 3.153829] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 gitlab # [ 3.161421] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 gitlab # [ 3.197389] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 gitlab # [ 3.231843] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray gitlab # [ 3.269365] cdrom: Uniform CD-ROM driver Revision: 3.20 gitlab # [ 3.306223] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 gitlab # [ 3.311138] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 gitlab # [ 3.315772] usb 1-1: Product: QEMU USB Tablet gitlab # [ 3.319782] usb 1-1: Manufacturer: QEMU gitlab # [ 3.322333] usb 1-1: SerialNumber: 28754-0000:00:01.2-1 gitlab # [ 3.361049] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 3.370517] usbcore: registered new interface driver usbhid gitlab # [ 3.371933] usbhid: USB HID core driver gitlab # [ 3.377840] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 gitlab # [ 3.380529] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0 gitlab # [ 3.322215] systemd[1]: Mounting /sysroot... gitlab # [ 3.767951] EXT4-fs (vda): mounted filesystem 6566b48e-7da9-4eb7-aee4-cbc272c776b4 r/w with ordered data mode. Quota mode: none. gitlab # [ 3.512612] systemd[1]: Mounted /sysroot. gitlab # [ 3.515168] systemd[1]: Reached target Initrd Root File System. gitlab # [ 3.518607] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 3.521506] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 3.524570] systemd[1]: Mounting /sysroot/run... gitlab # [ 3.526652] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 3.540271] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 3.541574] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 3.545173] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 3.550547] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.815309] 9p: Installing v9fs 9p2000 file system support gitlab # [ 3.555942] systemd-sysroot-fstab-check[181]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 3.558783] systemd[1]: Mounted /sysroot/run. gitlab # [ 3.560361] systemd[1]: Reload requested from client PID 181 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 3.563309] systemd[1]: Reloading... gitlab # [ 3.827903] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 3.633934] systemd[1]: Reloading finished in 74 ms. gitlab # [ 3.659149] systemd-sysroot-fstab-check[181]: Requesting initrd-fs.target/start/replace... gitlab # [ 3.664404] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 3.667934] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 3.671801] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 3.675173] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.679780] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.683686] systemd-sysroot-fstab-check[181]: Requesting swap.target/start/replace... gitlab # [ 3.688657] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.692573] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 3.696209] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 3.699572] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 3.703395] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.707127] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 4.323509] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 4.379627] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 4.383327] systemd[1]: Reached target Initrd File Systems. gitlab # [ 4.387365] systemd[1]: Starting Find NixOS closure... gitlab # [ 4.390993] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 4.419464] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 4.424697] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 4.448601] systemd[1]: Finished Find NixOS closure. gitlab # [ 4.452265] systemd[1]: Reached target Initrd Default Target. gitlab # [ 4.455989] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 4.500223] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 4.503864] systemd[1]: Stopped target Basic System. gitlab # [ 4.507352] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 4.510831] systemd[1]: Stopped target Path Units. gitlab # [ 4.514511] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 4.520267] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 4.525527] systemd[1]: Stopped target Slice Units. gitlab # [ 4.528797] systemd[1]: Stopped target Socket Units. gitlab # [ 4.531800] systemd[1]: Stopped target System Initialization. gitlab # [ 4.535308] systemd[1]: Stopped target Swaps. gitlab # [ 4.537972] systemd[1]: Stopped target Timer Units. gitlab # [ 4.541123] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 4.544389] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 4.547408] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 4.550884] systemd[1]: Stopped Find NixOS closure. gitlab # [ 4.553345] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 4.558306] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 4.561155] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 4.563529] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 4.565209] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 4.567244] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 4.568678] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 4.570527] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 4.572384] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 4.574203] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 4.575713] systemd[1]: Stopped target Local File Systems. gitlab # [ 4.577083] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 4.578656] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 4.580358] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 4.581657] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 4.583477] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 4.585391] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 4.586642] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 4.588255] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 4.589789] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 4.591456] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 4.592824] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 4.594406] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 4.596115] systemd[1]: systemd-udevd.service: Consumed 1.048s CPU time over 2.156s wall clock time, 27.8M memory peak. gitlab # [ 4.598536] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 4.600297] systemd[1]: Closed udev Control Socket. gitlab # [ 4.601528] systemd[1]: Starting Cleanup udev Database... gitlab # [ 4.602848] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 4.604657] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 4.606178] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 4.608100] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 4.609824] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 4.611516] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 4.613221] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 4.615044] systemd[1]: Finished Cleanup udev Database. gitlab # [ 4.616391] systemd[1]: Reached target Switch Root. gitlab # [ 4.617814] systemd[1]: Starting NixOS Activation... gitlab # [ 4.673300] initrd-nixos-activation-start[232]: booting system configuration /nix/store/rfdaqkmfjlz0cvmb4v3ihvhrhbkx2b5n-nixos-system-gitlab-test gitlab # [ 4.703930] initrd-nixos-activation-start[232]: running activation script... gitlab # [ 4.918087] initrd-nixos-activation-start[255]: setting up /etc... gitlab # [ 5.038721] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 5.041178] systemd[1]: Finished NixOS Activation. gitlab # [ 5.044539] systemd[1]: Starting Switch Root... gitlab # [ 5.079247] systemd[1]: Switching root. gitlab # [ 5.407451] systemd-journald[94]: Received SIGTERM from PID 1 (systemd). gitlab # [ 5.525996] NET: Registered PF_VSOCK protocol family gitlab # [ 5.920763] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.936908] systemd[1]: Detected virtualization kvm. gitlab # [ 5.939990] systemd[1]: Detected architecture x86-64. gitlab # [ 5.943292] systemd[1]: Detected first boot. gitlab # [ 5.947241] systemd[1]: Initializing machine ID from random generator. gitlab # [ 6.089991] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 6.177728] systemd[1]: Applying preset policy. gitlab # [ 6.340880] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 6.472540] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 6.474917] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 6.478277] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 6.481785] systemd[1]: Created slice Slice /system/getty. gitlab # [ 6.483974] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 6.486200] systemd[1]: Created slice User and Session Slice. gitlab # [ 6.487814] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 6.489835] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 6.491734] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 6.492993] systemd[1]: Expecting device /dev/ttyS0... gitlab # [ 6.494333] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 6.495864] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 6.497183] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 6.498606] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 6.500205] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 6.501835] systemd[1]: Reached target Path Units. gitlab # [ 6.503139] systemd[1]: Reached target Remote File Systems. gitlab # [ 6.504541] systemd[1]: Reached target Slice Units. gitlab # [ 6.505917] systemd[1]: Reached target Swaps. gitlab # [ 6.508057] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 6.510903] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 6.512974] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 6.515290] systemd[1]: Listening on Factory Reset Management. gitlab # [ 6.516902] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 6.520368] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 6.522766] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 6.525602] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 6.527520] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 6.529402] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.531835] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 6.535585] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 6.537378] systemd[1]: Listening on udev Control Socket. gitlab # [ 6.538930] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 6.554971] systemd[1]: Mounting Huge Pages File System... gitlab # [ 6.557997] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 6.561156] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 6.565014] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 6.570537] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 6.572250] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 6.577718] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 6.579336] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 6.581806] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.584558] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 6.590793] systemd[1]: Mounting FUSE Control File System... gitlab # [ 6.592251] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.599788] systemd[1]: Starting Journal Service... gitlab # [ 6.610250] systemd[1]: Starting Load Kernel Modules... gitlab # [ 6.613938] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 6.619816] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 6.621465] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.626569] systemd-journald[327]: Collecting audit messages is enabled. gitlab # [ 6.626795] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 6.633796] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 6.635409] systemd[1]: Mounted Huge Pages File System. gitlab # [ 6.637021] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 6.638839] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 6.640509] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 6.642536] loop: module loaded gitlab # [ 6.642718] EXT4-fs (vda): re-mounted 6566b48e-7da9-4eb7-aee4-cbc272c776b4. gitlab # [ 6.643826] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 6.648390] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 6.389912] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 6.392183] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 6.652762] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 6.394324] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 6.396931] systemd-modules-load[328]: Using 3 probe threads gitlab # [ 6.657356] systemd[1]: Started Journal Service. gitlab # [ 6.398824] systemd-modules-load[328]: Inserted module 'tls' gitlab # [ 6.400968] systemd-modules-load[328]: Inserted module 'loop' gitlab # [ 6.403394] systemd[1]: Mounted FUSE Control File System. gitlab # [ 6.405378] systemd-oomd[330]: No swap; memory pressure usage will be degraded gitlab # [ 6.407921] systemd[1]: Finished Load Kernel Modules. gitlab # [ 6.409432] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 6.411846] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 6.421545] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 6.424798] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 6.426527] systemd[1]: Starting Firewall... gitlab # [ 6.429225] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 6.433264] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.435959] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 6.444218] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 6.711396] systemd-journald[327]: Received client request to flush runtime journal. gitlab # [ 6.521258] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 6.524154] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.526882] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 6.529409] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 6.531237] systemd[1]: Reached target First Boot Complete. gitlab # [ 6.532774] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 6.534279] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 6.536246] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 6.537970] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 6.539676] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 6.541486] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 6.543629] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 6.545695] systemd-udevd[366]: Using default interface naming scheme 'v261'. gitlab # [ 6.551202] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 6.577536] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 6.689604] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 6.723680] systemd[1]: Finished Firewall. gitlab # [ 6.735350] (udev-worker)[438]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.740250] (udev-worker)[453]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 6.743796] (udev-worker)[453]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.746191] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 6.750142] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. gitlab # [ 6.761483] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 6.763428] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.765921] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.769805] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.772579] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.774793] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.090791] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 gitlab # [ 7.101003] ACPI: button: Power Button [PWRF] gitlab # [ 7.107172] Floppy drive(s): fd0 is 2.88M AMI BIOS gitlab # [ 7.120517] FDC 0 is a S82078B gitlab # [ 7.128698] rtc_cmos 00:05: RTC can wake from S4 gitlab # [ 7.132509] parport_pc 00:03: reported by Plug and Play ACPI gitlab # [ 7.132774] mousedev: PS/2 mouse device common for all mice gitlab # [ 7.135420] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] gitlab # [ 7.141897] rtc_cmos 00:05: registered as rtc0 gitlab # [ 7.143268] rtc_cmos 00:05: setting system clock to 2026-08-11T10:07:22 UTC (1786442842) gitlab # [ 7.145490] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs gitlab # [ 7.148883] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 gitlab # [ 7.150932] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD gitlab # [ 7.152706] systemd-journald[327]: Time jumped backwards, rotating. gitlab # [ 7.154810] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console gitlab # [ 7.173444] Console: switching to colour dummy device 80x25 gitlab # [ 7.174969] [drm] Found bochs VGA, ID 0xb0c5. gitlab # [ 7.176721] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. gitlab # [ 7.182544] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4 gitlab # [ 7.187746] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic gitlab # [ 7.189033] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0 gitlab # [ 7.192583] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 gitlab # [ 7.203578] Console: switching to colour frame buffer device 160x50 gitlab # [ 7.205795] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device gitlab # [ 7.219747] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 gitlab # [ 7.009293] systemd[1]: Starting Virtual Console Setup... gitlab # [ 7.316873] ppdev: user-space parallel port driver gitlab # [ 7.066540] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 7.068636] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 7.086297] systemd[1]: Starting Virtual Console Setup... gitlab # [ 7.091788] systemd[1]: systemd-vconsole-setup.service: Deactivated successfu[ 7.353756] kvm_amd: TSC scaling supported gitlab # lly. gitlab # [ 7.094564] systemd[1]: Stopped Virtual Console Setup.[ 7.356350] kvm_amd: Nested Virtualization enabled gitlab # gitlab # [ 7.357423] kvm_amd: Nested Paging enabled gitlab # [ 7.097413] s[ 7.358336] kvm_amd: LBR virtualization supported gitlab # ystemd[1]: Start[ 7.359496] kvm_amd: Virtual VMLOAD VMSAVE supported gitlab # ing Virtual Cons[ 7.360774] kvm_amd: Virtual GIF supported gitlab # ole Setup...[ 7.361567] kvm_amd: Virtual NMI enabled gitlab # gitlab # [ 7.410135] EDAC MC: Ver: 3.0.0 gitlab # [ 7.158541] systemd-vconsole-setup[501]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 7.161566] systemd[1]: Finished Virtual Console Setup. gitlab # [ 7.214323] systemd[1]: Mounting /run/wrappers... gitlab # [ 7.240950] systemd[1]: Mounted /run/wrappers. gitlab # [ 7.242573] systemd[1]: Reached target Local File Systems. gitlab # [ 7.244238] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 7.247217] systemd[1]: Starting register-nix-paths.service... gitlab # [ 7.249590] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 7.251181] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.253295] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 7.262278] systemd[1]: Starting Create System Files and Directories... gitlab # [ 7.295663] systemd[1]: Finished Create System Files and Directories. gitlab # [ 7.300412] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 7.303721] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 7.306477] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 7.311941] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 7.323795] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 7.339704] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 7.342452] systemd[1]: Starting Update is Completed... gitlab # [ 7.358581] systemd[1]: Finished Update is Completed. gitlab # [ 7.405583] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 7.407420] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.638416] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.640485] systemd[1]: Reached target System Initialization. gitlab # [ 7.642511] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.644708] systemd[1]: Started logrotate.timer. gitlab # [ 7.646446] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.648586] systemd[1]: Reached target Timer Units. gitlab # [ 7.650426] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.652517] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.656707] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.658601] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.665245] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.667301] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.669469] systemd[1]: Reached target Socket Units. gitlab # [ 7.724297] dbus-broker-launch[583]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.729314] dbus-broker-launch[583]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.733402] dbus-broker-launch[583]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.740720] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.751245] dbus-broker-launch[583]: Ready gitlab # [ 7.757262] systemd[1]: Reached target Basic System. gitlab # [ 7.761523] systemd[1]: Started backdoor.service. gitlab # [ 7.765881] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.783479] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 7.787290] systemd[1]: Starting Logrotate configuration check... gitlab # [ 7.791589] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.797230] systemd[1]: Starting Post-Boot Actions... gitlab # connecting to host... gitlab # [ 7.810612] systemd[1]: Started Reset console on configuration changes. gitlab # [ 7.815380] systemd[1]: Starting resolvconf update... gitlab # [ 7.822219] logrotate[588]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab # [ 7.823160] logrotate[588]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf gitlab # [ 7.823924] logrotate[588]: note: 'monthly' overrides previously specified 'weekly' gitlab # [ 7.827964] logrotate[588]: Reading state from file: /var/lib/logrotate.status gitlab # [ 7.829046] logrotate[588]: state file /var/lib/logrotate.status does not exist gitlab # [ 7.829878] logrotate[588]: Allocating hash table for state file, size 64 entries gitlab # [ 7.834595] logrotate[588]: Handling 4 logs gitlab # [ 7.835348] logrotate[588]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.835932] logrotate[588]: considering log /var/log/btmp gitlab # [ 7.839718] logrotate[588]: Creating new state gitlab # [ 7.840893] logrotate[588]: Now: 2026-08-11 10:07 gitlab # [ 7.841865] logrotate[588]: Last rotated at 2026-08-11 10:00 gitlab # [ 7.845196] logrotate[588]: log does not need rotating (log has already been rotated) gitlab # [ 7.845896] logrotate[588]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.847190] logrotate[588]: considering log /var/log/wtmp gitlab # [ 7.847911] logrotate[588]: Creating new state gitlab # [ 7.850703] logrotate[588]: Now: 2026-08-11 10:07 gitlab # [ 7.851793] logrotate[588]: Last rotated at 2026-08-11 10:00 gitlab # [ 7.852975] logrotate[588]: log does not need rotating (log has already been rotated) gitlab # [ 7.856092] logrotate[588]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 7.856543] logrotate[588]: switching euid from 0 to 165 and egid from 0 to 165 (pid 588) gitlab # [ 7.857451] logrotate[588]: considering log /var/gitlab/state/log/*.log gitlab # [ 7.858747] logrotate[588]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 7.859958] logrotate[588]: Creating new state gitlab # [ 7.861236] logrotate[588]: switching euid from 165 to 0 and egid from 165 to 0 (pid 588) gitlab # [ 7.862089] logrotate[588]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 7.862744] logrotate[588]: switching euid from 0 to 60 and egid from 0 to 60 (pid 588) gitlab # [ 7.863875] logrotate[588]: considering log /var/log/nginx/*.log gitlab # [ 7.864986] logrotate[588]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 7.865880] logrotate[588]: Creating new state gitlab # [ 7.866970] logrotate[588]: not running postrotate script, since no logs were rotated gitlab # [ 7.868130] logrotate[588]: switching euid from 60 to 0 and egid from 60 to 0 (pid 588) gitlab # [ 7.869329] systemd[1]: Finished Logrotate configuration check. gitlab # [ 7.870753] nsncd[589]: Aug 11 10:07:23.458 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.872110] systemd[1]: Finished Post-Boot Actions. gitlab # [ 7.873351] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 7.874940] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.876533] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.877761] systemd[1]: Starting User Login Management... gitlab: connected to guest root shell gitlab # [ 7.878871] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab: (connecting took 8.74 seconds) gitlab: (finished: waiting for the VM to finish booting, in 8.74 seconds) gitlab # [ 7.924792] systemd-logind[620]: New seat seat0. gitlab # [ 7.927849] systemd-logind[620]: Watching system buttons on /dev/input/event2 (Power Button) gitlab # [ 7.928557] systemd-logind[620]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 7.929881] systemd-logind[620]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) gitlab # [ 7.931309] systemd[1]: Started User Login Management. gitlab # [ 7.935493] systemd[1]: Starting linger-users.service... gitlab # [ 7.951312] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 7.953119] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 7.954725] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 7.956514] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 7.957217] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 7.958225] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 7.959096] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 7.959882] systemd[1]: nscd.service: Consumed 26ms CPU time over 166ms wall clock time, 7.2M memory peak, 5.5M read from disk. gitlab # [ 7.965870] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 7.967741] systemd[1]: Finished linger-users.service. gitlab # [ 7.972465] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.989311] nsncd[683]: Aug 11 10:07:23.606 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.990363] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.991351] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.992185] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 8.003172] systemd[1]: Finished resolvconf update. gitlab # [ 8.004188] systemd[1]: Reached target Preparation for Network. gitlab # [ 8.008147] systemd[1]: Starting DHCP Client... gitlab # [ 8.010111] systemd[1]: Starting Address configuration of eth1... gitlab # [ 8.012417] systemd[1]: Starting Extra networking commands.... gitlab # [ 8.036430] network-addresses-eth1-start[706]: adding address 192.168.1.1/24... done gitlab # [ 8.039972] network-addresses-eth1-start[706]: adding address 2001:db8:1::1/64... done gitlab # [ 8.046085] systemd[1]: Finished Address configuration of eth1. gitlab # [ 8.090196] systemd[1]: Finished Extra networking commands.. gitlab # [ 8.092272] dhcpcd[722]: dhcpcd-10.3.2 starting gitlab # [ 8.093686] systemd[1]: Reached target Network. gitlab # [ 8.095346] dhcpcd[771]: dev: loaded udev gitlab # [ 8.096614] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 8.098205] systemd[1]: Starting Nginx Web Server... gitlab # [ 8.362816] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 8.363623] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 8.105410] systemd[1]: Starting PostgreSQL Server... gitlab # [ 8.119104] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 8.119917] systemd[1]: Starting Permit User Sessions... gitlab # [ 8.144141] systemd[1]: Finished Permit User Sessions. gitlab # [ 8.144946] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 8.151108] systemd[1]: Started Getty on tty1. gitlab # [ 8.153100] systemd[1]: Reached target Login Prompts. gitlab # [ 8.463339] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 8.475228] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 8.477154] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 8.481728] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 8.483384] cfg80211: failed to load regulatory.db gitlab # [ 8.512324] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 8.253561] dhcpcd[771]: eth0: waiting for carrier gitlab # [ 8.254191] dhcpcd[771]: eth0: carrier acquired gitlab # [ 8.256824] dhcpcd[771]: DUID 00:01:00:01:32:0d:b0:db:52:54:00:12:34:56 gitlab # [ 8.257948] dhcpcd[771]: eth0: IAID 00:12:34:56 gitlab # [ 8.258610] dhcpcd[771]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 8.282396] nginx-pre-start[797]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok gitlab # [ 8.283322] nginx-pre-start[797]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful gitlab # [ 8.289365] redis-server[795]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 8.290516] redis-server[795]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 8.291401] redis-server[795]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=795, just started gitlab # [ 8.293259] redis-server[795]: Configuration loaded gitlab # [ 8.294070] redis[795]: monotonic clock: POSIX clock_gettime gitlab # [ 8.295065] redis[795]: Running mode=standalone, port=0. gitlab # [ 8.297044] redis[795]: Server initialized gitlab # [ 8.297957] redis[795]: Ready to accept connections unix gitlab # [ 8.298926] redis[795]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 8.308227] postgresql-pre-start[802]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 8.308812] systemd[1]: Started Nginx Web Server. gitlab # [ 8.310294] postgresql-pre-start[802]: This user must also own the server process. gitlab # [ 8.314769] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 8.316264] postgresql-pre-start[802]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 8.318695] postgresql-pre-start[802]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 8.321416] postgresql-pre-start[802]: The default text search configuration will be set to "english". gitlab # [ 8.321866] postgresql-pre-start[802]: Data page checksums are enabled. gitlab # [ 8.324154] postgresql-pre-start[802]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 8.325454] postgresql-pre-start[802]: creating subdirectories ... ok gitlab # [ 8.326105] postgresql-pre-start[802]: selecting dynamic shared memory implementation ... posix gitlab # [ 8.361570] postgresql-pre-start[802]: selecting default "max_connections" ... 100 gitlab # [ 8.400075] postgresql-pre-start[802]: selecting default "shared_buffers" ... 128MB gitlab # [ 8.655575] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 8.797404] postgresql-pre-start[802]: selecting default time zone ... UTC gitlab # [ 8.799598] postgresql-pre-start[802]: creating configuration files ... ok gitlab # [ 8.888475] gitlab-workhorse[831]: time="2026-08-11T10:07:24Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 8.889169] gitlab-workhorse[831]: time="2026-08-11T10:07:24Z" level=info msg="Using redis/go-redis" gitlab # [ 8.890127] gitlab-workhorse[831]: time="2026-08-11T10:07:24Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 8.973160] postgresql-pre-start[802]: running bootstrap script ... ok gitlab # [ 9.324749] dhcpcd[771]: eth0: soliciting a DHCP lease gitlab # [ 9.591862] NET: Registered PF_PACKET protocol family gitlab # [ 9.336581] dhcpcd[771]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 9.342396] dhcpcd[771]: eth0: probing address 10.0.2.15/24 gitlab # [ 9.467187] postgresql-pre-start[802]: performing post-bootstrap initialization ... ok gitlab # [ 9.753061] postgresql-pre-start[802]: syncing data to disk ... ok gitlab # [ 9.754723] postgresql-pre-start[802]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 9.757066] postgresql-pre-start[802]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 9.760790] postgresql-pre-start[802]: Success. You can now start the database server using: gitlab # [ 9.762830] postgresql-pre-start[802]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 9.851360] postgres[857]: [857] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 9.854405] postgres[857]: [857] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 9.856342] postgres[857]: [857] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 9.858575] postgres[857]: [857] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 9.873613] postgres[866]: [866] LOG: database system was shut down at 2026-08-11 10:07:25 GMT gitlab # [ 9.881414] postgres[857]: [857] LOG: database system is ready to accept connections gitlab # [ 9.888176] systemd[1]: Started PostgreSQL Server. gitlab # [ 9.890242] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 10.110501] postgresql-setup-start[877]: CREATE DATABASE gitlab # [ 10.132297] postgresql-setup-start[891]: CREATE ROLE gitlab # [ 10.142588] postgresql-setup-start[893]: ALTER DATABASE gitlab # [ 10.165178] postgresql-setup-start[898]: CREATE ROLE gitlab # [ 10.167841] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 10.168925] systemd[1]: Reached target PostgreSQL. gitlab # [ 10.170745] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 10.278671] gitlab-postgresql-start[906]: CREATE DATABASE gitlab # [ 10.325756] gitlab-postgresql-start[910]: CREATE EXTENSION gitlab # [ 10.427629] gitlab-postgresql-start[912]: CREATE EXTENSION gitlab # [ 10.433304] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 10.541881] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[917]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 10.545397] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[917]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 10.629266] systemd[1]: Finished gitlab-config.service. gitlab # [ 10.632248] systemd[1]: Started gitaly.service. gitlab # [ 10.635420] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 10.853353] dhcpcd[771]: eth0: soliciting an IPv6 router gitlab # [ 10.854650] dhcpcd[771]: eth0: Router Advertisement from fe80::2 gitlab # [ 10.856434] dhcpcd[771]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 10.857644] dhcpcd[771]: eth0: adding route to fec0::/64 gitlab # [ 10.859597] dhcpcd[771]: eth0: adding default route via fe80::2 gitlab # [ 11.205662] gitaly[932]: time="2026-08-11T10:07:26.821Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=932 gitlab # [ 11.208296] gitaly[932]: time="2026-08-11T10:07:26.822Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=932 gitlab # [ 11.210775] gitaly[932]: time="2026-08-11T10:07:26.822Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=932 gitlab # [ 11.213712] gitaly[932]: time="2026-08-11T10:07:26.822Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=932 gitlab # [ 11.215436] gitaly[932]: time="2026-08-11T10:07:26.822Z" level=info msg="Starting Gitaly" pid=932 version= gitlab # [ 11.406956] gitaly[932]: time="2026-08-11T10:07:27.024Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=176 pid=932 gitlab # [ 11.407775] gitaly[932]: time="2026-08-11T10:07:27.024Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=932 gitlab # [ 11.409602] gitaly[932]: time="2026-08-11T10:07:27.026Z" level=info msg="finished initializing command factory" duration_ms=2 pid=932 gitlab # [ 11.411080] gitaly[932]: time="2026-08-11T10:07:27.026Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-932/git-exec-801265972.d/git pid=932 gitlab # [ 11.424230] gitaly[932]: time="2026-08-11T10:07:27.041Z" level=info msg="finished detecting git version" duration_ms=14 pid=932 gitlab # [ 11.425454] gitaly[932]: time="2026-08-11T10:07:27.042Z" level=info msg="using Git version" pid=932 version=2.53.g gitlab # [ 11.428395] gitaly[932]: time="2026-08-11T10:07:27.045Z" level=info msg="clearing disk cache object folder" pid=932 storage=default gitlab # [ 11.429665] gitaly[932]: time="2026-08-11T10:07:27.047Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1572408965 pid=932 storage=default gitlab # [ 11.431324] gitaly[932]: time="2026-08-11T10:07:27.048Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1572408965 pid=932 storage=default gitlab # [ 11.433544] gitaly[932]: time="2026-08-11T10:07:27.048Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=932 gitlab # [ 11.435780] gitaly[932]: time="2026-08-11T10:07:27.048Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=932 gitlab # [ 11.437685] gitaly[932]: time="2026-08-11T10:07:27.051Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1572408965 clear_duration_ms=0 pid=932 storage=default gitlab # [ 11.539313] gitaly[932]: time="2026-08-11T10:07:27.156Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=932 gitlab # [ 11.539855] gitaly[932]: time="2026-08-11T10:07:27.156Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=932 schema=unix gitlab # [ 11.540986] gitaly[932]: time="2026-08-11T10:07:27.156Z" level=info msg="listening at address" address=/run/gitaly/gitaly-932/sock.d/intern pid=932 schema=unix gitlab # [ 11.541782] gitaly[932]: time="2026-08-11T10:07:27.156Z" level=info msg="finished tempdir cleaner walk" pid=932 storage=default time_ms=0 gitlab # [ 11.543895] gitaly[932]: time="2026-08-11T10:07:27.156Z" level=info msg="counting repositories" pid=932 gitlab # [ 11.545459] gitaly[932]: time="2026-08-11T10:07:27.160Z" level=info msg="starting to count repositories" pid=932 storage_path=/var/gitlab/state/repositories gitlab # [ 11.547064] gitaly[932]: time="2026-08-11T10:07:27.160Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=932 storage_path=/var/gitlab/state/repositories gitlab # [ 11.548598] gitaly[932]: time="2026-08-11T10:07:27.160Z" level=info msg="completed counting all repositories" counting_duration=0 pid=932 gitlab # [ 11.564989] gitaly[932]: time="2026-08-11T10:07:27.182Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=932 gitlab # [ 11.566885] gitaly[932]: time="2026-08-11T10:07:27.182Z" level=info msg="Started Gitaly" duration_ms=359 pid=932 gitlab # [ 11.568692] gitaly[932]: time="2026-08-11T10:07:27.182Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=932 gitlab # [ 11.570657] gitaly[932]: time="2026-08-11T10:07:27.182Z" level=info msg="maintenance: daily scheduled" pid=932 scheduled="2026-08-11 12:00:00 +0000 UTC" gitlab # [ 12.117531] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[935]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.121755] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[935]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.148122] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[935]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 13.434159] gitaly[932]: time="2026-08-11T10:07:29.050Z" level=info msg="License database preloaded" duration_ms=2227 pid=932 gitlab # [ 13.526189] dhcpcd[771]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 13.528246] dhcpcd[771]: eth0: adding route to 10.0.2.0/24 gitlab # [ 13.531122] dhcpcd[771]: eth0: adding default route via 10.0.2.2 gitlab # [ 13.687729] systemd[1]: Started DHCP Client. gitlab # [ 13.692562] systemd[1]: Reached target Network is Online. gitlab # [ 44.130745] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[935]: W, [2026-08-11T10:07:59.746992 #935] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 46.171147] postgres[1337]: [1337] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 46.176522] postgres[1337]: [1337] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 46.181868] postgres[1337]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 46.187705] postgres[1337]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 46.192938] postgres[1337]: attidentity AS identity, gitlab # [ 46.196668] postgres[1337]: attgenerated as attgenerated gitlab # [ 46.200648] postgres[1337]: FROM pg_attribute a gitlab # [ 46.204137] postgres[1337]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 46.209714] postgres[1337]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 46.213957] postgres[1337]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 46.219141] postgres[1337]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 46.222559] postgres[1337]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 46.225845] postgres[1337]: ORDER BY a.attnum gitlab # [ 46.228412] postgres[1337]: gitlab # [ 48.957701] gitlab-workhorse[831]: time="2026-08-11T10:08:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 49.798771] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1375]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 49.801191] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1375]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 58.968628] gitlab-workhorse[831]: time="2026-08-11T10:08:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 68.900431] postgres[1468]: [1468] ERROR: relation "table_without_models" does not exist gitlab # [ 68.905720] postgres[1468]: [1468] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 68.978158] gitlab-workhorse[831]: time="2026-08-11T10:08:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 78.989149] gitlab-workhorse[831]: time="2026-08-11T10:08:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 82.984245] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 82.993485] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 83.002262] systemd[1]: Starting gitlab.service... gitlab # [ 83.409964] bundle[1662]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 83.418487] bundle[1662]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 83.426850] bundle[1662]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 86.462879] sidekiq-cluster[1661]: {"severity":"INFO","time":"2026-08-11T10:08:42.060Z","message":"Starting cluster with 1 processes"} gitlab # [ 86.510535] bundle[1662]: {"timestamp":"2026-08-11T10:08:42.105Z","pid":1662,"message":"* Enabling systemd notification integration"} gitlab # [ 86.517267] bundle[1662]: {"timestamp":"2026-08-11T10:08:42.126Z","pid":1662,"message":"Puma starting in cluster mode..."} gitlab # [ 86.523865] bundle[1662]: {"timestamp":"2026-08-11T10:08:42.127Z","pid":1662,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 86.531411] bundle[1662]: {"timestamp":"2026-08-11T10:08:42.127Z","pid":1662,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 86.539638] bundle[1662]: {"timestamp":"2026-08-11T10:08:42.127Z","pid":1662,"message":"* Min threads: 0"} gitlab # [ 86.545579] bundle[1662]: {"timestamp":"2026-08-11T10:08:42.127Z","pid":1662,"message":"* Max threads: 4"} gitlab # [ 86.551564] bundle[1662]: {"timestamp":"2026-08-11T10:08:42.127Z","pid":1662,"message":"* Environment: production"} gitlab # [ 86.558287] bundle[1662]: {"timestamp":"2026-08-11T10:08:42.127Z","pid":1662,"message":"* Master PID: 1662"} gitlab # [ 86.563571] bundle[1662]: {"timestamp":"2026-08-11T10:08:42.127Z","pid":1662,"message":"* Workers: 2"} gitlab # [ 86.568320] bundle[1662]: {"timestamp":"2026-08-11T10:08:42.127Z","pid":1662,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 86.574097] bundle[1662]: {"timestamp":"2026-08-11T10:08:42.127Z","pid":1662,"message":"* Preloading application"} gitlab # [ 89.000365] gitlab-workhorse[831]: time="2026-08-11T10:08:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 99.010751] gitlab-workhorse[831]: time="2026-08-11T10:08:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 109.020828] gitlab-workhorse[831]: time="2026-08-11T10:09:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 111.356099] bundle[1662]: W, [2026-08-11T10:09:06.972509 #1662] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 113.531500] sidekiq-cluster[1701]: 2026-08-11T10:09:09.147Z pid=1701 tid=wel INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1701, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432979968} gitlab # [ 113.718392] sidekiq-cluster[1701]: W, [2026-08-11T10:09:09.335379 #1701] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 113.758972] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:09.375Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 115.788224] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.404Z","message":"GitLab reliable fetch activated!"} gitlab # [ 115.794871] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.404Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 115.814362] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.431Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 115.819584] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.436Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 115.836745] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.453Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 115.850201] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.467Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 115.865506] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.482Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 115.877555] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.494Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 115.889398] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.506Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 115.901708] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.518Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 115.910819] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.527Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 115.918555] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.535Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 115.927516] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.544Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 115.937978] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.555Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 115.946500] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.563Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 115.958140] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.575Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 115.967246] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.584Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 115.973091] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.590Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 115.979728] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.597Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 115.983826] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.601Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 115.987474] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.604Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 115.991416] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.608Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 115.995494] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.612Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 115.998704] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.616Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 116.005120] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.621Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 116.013502] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.630Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 116.020098] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.637Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 116.026320] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.643Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 116.035033] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.652Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 116.043642] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.660Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 116.052410] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.669Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 116.060886] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.678Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 116.068893] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.686Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 116.077880] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.695Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 116.086230] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.703Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 116.094889] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.712Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 116.103854] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.720Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 116.112266] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.729Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 116.120528] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.737Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 116.130892] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.747Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 116.140603] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.757Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 116.150620] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.767Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 116.160460] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.777Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 116.169530] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.786Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 116.179369] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.796Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 116.189757] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.806Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 116.202131] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.819Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 116.210212] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.827Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 116.217516] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.834Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 116.227220] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.844Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 116.237856] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.854Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 116.248213] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.865Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 116.258206] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.875Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 116.269596] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.886Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 116.304116] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.920Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 116.312595] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.929Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 116.321699] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.938Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 116.331856] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.949Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 116.341212] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.958Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 116.351363] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.968Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 116.358827] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.975Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 116.365809] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.982Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 116.373189] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.990Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 116.379835] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:11.997Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 116.388281] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.005Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 116.396214] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.013Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 116.401576] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.018Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 116.406955] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.024Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 116.411465] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.028Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 116.447341] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.064Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 116.452139] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.069Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 116.457200] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.074Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 116.462610] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.079Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 116.468628] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.085Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 116.475276] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.092Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 116.479633] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.096Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 116.484725] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.101Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 116.489180] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.106Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 116.493762] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.111Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 116.497718] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.115Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 116.500977] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.118Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 116.503998] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.121Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 116.507153] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.124Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 116.511053] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.128Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 116.514785] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.132Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 116.518643] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.135Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 116.522332] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.139Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 116.525975] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.143Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 116.529152] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.146Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 116.533573] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.150Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 116.536733] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.154Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 116.540814] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.158Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 116.543594] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.160Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 116.546965] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.164Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 116.550325] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.167Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 116.553852] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.171Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 116.557428] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.174Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 116.561527] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.178Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 116.564667] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.181Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 116.568582] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.185Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 116.579895] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.197Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 116.582732] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.200Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 116.586301] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.203Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 116.590760] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.208Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 116.593989] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.211Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 116.597122] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.214Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 116.601088] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.218Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 116.604076] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.221Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 116.607206] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.224Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 116.611403] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.228Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 116.614892] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:12.232Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 119.030636] gitlab-workhorse[831]: time="2026-08-11T10:09:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 129.033796] gitlab-workhorse[831]: time="2026-08-11T10:09:24Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 138.875207] postgres[2177]: [2177] ERROR: relation "table_without_models" does not exist gitlab # [ 138.877349] postgres[2177]: [2177] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 139.035841] gitlab-workhorse[831]: time="2026-08-11T10:09:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 139.649480] postgres[2188]: [2188] ERROR: relation "table_without_models" does not exist gitlab # [ 139.650670] postgres[2188]: [2188] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 141.602238] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:37.218Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 141.609299] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:37.226Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 141.612599] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:37.226Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 141.615689] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:37.226Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 141.619150] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:37.232Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 142.632852] bundle[1662]: {"timestamp":"2026-08-11T10:09:38.249Z","pid":1662,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 142.634637] bundle[1662]: {"timestamp":"2026-08-11T10:09:38.249Z","pid":1662,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 142.637672] bundle[1662]: {"timestamp":"2026-08-11T10:09:38.249Z","pid":1662,"message":"! #\u003cThread:0x00007ffae9b3a830 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 142.639508] bundle[1662]: {"timestamp":"2026-08-11T10:09:38.249Z","pid":1662,"message":"! #\u003cThread:0x00007ffae9e36db8 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 142.641606] bundle[1662]: {"timestamp":"2026-08-11T10:09:38.249Z","pid":1662,"message":"Use Ctrl-C to stop"} gitlab # [ 142.666995] bundle[1662]: {"timestamp":"2026-08-11T10:09:38.250Z","pid":1662,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 143.076273] bundle[1662]: {"timestamp":"2026-08-11T10:09:38.693Z","pid":1662,"message":"- Worker 0 (PID: 2244) booted in 0.37s, phase: 0"} gitlab # [ 143.092215] bundle[1662]: {"timestamp":"2026-08-11T10:09:38.709Z","pid":1662,"message":"- Worker 1 (PID: 2248) booted in 0.37s, phase: 0"} gitlab # [ 143.106536] systemd[1]: Started gitlab.service. gitlab # [ 143.110282] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 143.117914] systemd[1]: Starting setup-gitlab.service... gitlab # [ 143.138659] setup-gitlab-start[2272]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 143.243433] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:38.860Z","message":"Cleaning working queues"} gitlab # [ 143.251945] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:38.868Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b83bb4f8f5367c3119021bd1","created_at":"2026-08-11T10:08:38.196Z","trace_propagation_headers":{"sentry-trace":"3d93a6ab16d3435485357db240a78cb5-a02873165a9a4a64","baggage":"sentry-trace_id=3d93a6ab16d3435485357db240a78cb5,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"16665c7e09bb429a0418797ce5d102aa","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T10:08:38.207Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b83bb4f8f5367c3119021bd1: start","job_status":"start","queue_duration_s":60.661082,"scheduling_latency_s":60.66114} gitlab # [ 143.404661] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:09:39.021Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b83bb4f8f5367c3119021bd1","created_at":"2026-08-11T10:08:38.196Z","trace_propagation_headers":{"sentry-trace":"3d93a6ab16d3435485357db240a78cb5-a02873165a9a4a64","baggage":"sentry-trace_id=3d93a6ab16d3435485357db240a78cb5,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"16665c7e09bb429a0418797ce5d102aa","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T10:08:38.207Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b83bb4f8f5367c3119021bd1: done: 0.152776 sec","job_status":"done","queue_duration_s":60.661082,"scheduling_latency_s":60.66114,"redis_calls":26,"redis_duration_s":0.007612,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.003823,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002068,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001721,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.085320341,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.152776,"completed_at":"2026-08-11T10:09:39.021Z","load_balancing_strategy":"primary","db_duration_s":0.045653,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 145.668709] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:09:41 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 2501 gitlab # [ 145.677834] setup-gitlab-start[2272]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 145.678259] setup-gitlab-start[2272]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 145.719937] runuser[2297]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 146.131388] setup-gitlab-start[2302]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 146.132216] setup-gitlab-start[2302]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 146.134927] setup-gitlab-start[2302]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 146.776235] setup-gitlab-start[2302]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 146.776820] setup-gitlab-start[2302]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 146.780926] setup-gitlab-start[2302]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 167.935761] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:03.551Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8e4725a55af141481cc02f48","created_at":"2026-08-11T10:10:03.503Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"854a61e5c7b6901c6c860153614bfc26","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:03.546Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8e4725a55af141481cc02f48: start","job_status":"start","queue_duration_s":0.004641,"scheduling_latency_s":0.004718} gitlab # [ 168.060787] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:03.677Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8e4725a55af141481cc02f48","created_at":"2026-08-11T10:10:03.503Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"854a61e5c7b6901c6c860153614bfc26","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:03.546Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8e4725a55af141481cc02f48: done: 0.126132 sec","job_status":"done","queue_duration_s":0.004641,"scheduling_latency_s":0.004718,"redis_calls":12,"redis_duration_s":0.018547,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002022,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010492,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006033,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.003771429,"exclusive_lock_hold_duration_s":0.021656662,"duration_s":0.126132,"completed_at":"2026-08-11T10:10:03.677Z","load_balancing_strategy":"primary","db_duration_s":0.014944,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 168.159116] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:03.775Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"04155e0b7c66dc90656918db","created_at":"2026-08-11T10:10:03.594Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"379d559c923d61605e3817f50c1e03a3","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:03.620Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-04155e0b7c66dc90656918db: start","job_status":"start","queue_duration_s":0.15538,"scheduling_latency_s":0.155452} gitlab # [ 168.283493] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:03.900Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"04155e0b7c66dc90656918db","created_at":"2026-08-11T10:10:03.594Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"379d559c923d61605e3817f50c1e03a3","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:03.620Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-04155e0b7c66dc90656918db: done: 0.124525 sec","job_status":"done","queue_duration_s":0.15538,"scheduling_latency_s":0.155452,"redis_calls":10,"redis_duration_s":0.013205,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002559,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006031,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004615,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001445715,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.004941969},"duration_s":0.124525,"completed_at":"2026-08-11T10:10:03.900Z","load_balancing_strategy":"primary","db_duration_s":0.055699,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 168.389438] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.006Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0c261385c4fb44d366808d04","created_at":"2026-08-11T10:10:03.641Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5957a95f22fb8a1420a051427e1cf822","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T10:10:03.799Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0c261385c4fb44d366808d04: start","job_status":"start","queue_duration_s":0.206801,"scheduling_latency_s":0.206848} gitlab # [ 168.431839] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.048Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 168.463439] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.080Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0c261385c4fb44d366808d04","created_at":"2026-08-11T10:10:03.641Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5957a95f22fb8a1420a051427e1cf822","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T10:10:03.799Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0c261385c4fb44d366808d04: done: 0.074053 sec","job_status":"done","queue_duration_s":0.206801,"scheduling_latency_s":0.206848,"redis_calls":10,"redis_duration_s":0.022006,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001733,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.018692,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001581,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.011204776,"duration_s":0.074053,"completed_at":"2026-08-11T10:10:04.080Z","load_balancing_strategy":"primary","db_duration_s":0.001528,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 168.469132] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.085Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"4779a881a1cbbf8793446c70","created_at":"2026-08-11T10:10:03.822Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e18b5b7fb66cd09a8ccbd3be5e29178","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:03.839Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-4779a881a1cbbf8793446c70: start","job_status":"start","queue_duration_s":0.245963,"scheduling_latency_s":0.246008} gitlab # [ 168.493948] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.110Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"4779a881a1cbbf8793446c70","created_at":"2026-08-11T10:10:03.822Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e18b5b7fb66cd09a8ccbd3be5e29178","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:03.839Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-4779a881a1cbbf8793446c70: done: 0.02542 sec","job_status":"done","queue_duration_s":0.245963,"scheduling_latency_s":0.246008,"redis_calls":10,"redis_duration_s":0.0034360000000000003,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000754,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002004,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000678,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000661537,"duration_s":0.02542,"completed_at":"2026-08-11T10:10:04.110Z","load_balancing_strategy":"primary","db_duration_s":0.002843,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 168.546425] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.112Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"397958bb231c936b8ce6728f","created_at":"2026-08-11T10:10:03.856Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a39e92d8d12350ab65a88ecee92c8a90","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:03.867Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-397958bb231c936b8ce6728f: start","job_status":"start","queue_duration_s":0.245078,"scheduling_latency_s":0.245101} gitlab # [ 168.569161] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.135Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"397958bb231c936b8ce6728f","created_at":"2026-08-11T10:10:03.856Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a39e92d8d12350ab65a88ecee92c8a90","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:03.867Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-397958bb231c936b8ce6728f: done: 0.023207 sec","job_status":"done","queue_duration_s":0.245078,"scheduling_latency_s":0.245101,"redis_calls":12,"redis_duration_s":0.002764,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000918,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001407,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000408991,"duration_s":0.023207,"completed_at":"2026-08-11T10:10:04.135Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003677,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 168.675413] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.136Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"6612989e15487348cc36c038","created_at":"2026-08-11T10:10:03.871Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4eaec1dee7c4b26573239fbaa92f4ec6","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:03.875Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-6612989e15487348cc36c038: start","job_status":"start","queue_duration_s":0.261081,"scheduling_latency_s":0.261101} gitlab # [ 168.676817] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.156Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"6612989e15487348cc36c038","created_at":"2026-08-11T10:10:03.871Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4eaec1dee7c4b26573239fbaa92f4ec6","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:03.875Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-6612989e15487348cc36c038: done: 0.019778 sec","job_status":"done","queue_duration_s":0.261081,"scheduling_latency_s":0.261101,"redis_calls":10,"redis_duration_s":0.002312,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000429,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001318,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000565,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000369042,"duration_s":0.019778,"completed_at":"2026-08-11T10:10:04.156Z","load_balancing_strategy":"primary","db_duration_s":0.000538,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 168.720158] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.158Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c13b609137a4fdd00cd3a882","created_at":"2026-08-11T10:10:03.879Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfca6dbf07cc1feeb3d51abe6242c3d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:03.891Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c13b609137a4fdd00cd3a882: start","job_status":"start","queue_duration_s":0.266154,"scheduling_latency_s":0.266175} gitlab # [ 168.742956] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.169Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 168.747867] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.176Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c13b609137a4fdd00cd3a882","created_at":"2026-08-11T10:10:03.879Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfca6dbf07cc1feeb3d51abe6242c3d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:03.891Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c13b609137a4fdd00cd3a882: done: 0.018346 sec","job_status":"done","queue_duration_s":0.266154,"scheduling_latency_s":0.266175,"redis_calls":10,"redis_duration_s":0.0022890000000000002,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000432,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000517,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000408152,"duration_s":0.018346,"completed_at":"2026-08-11T10:10:04.176Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 168.816161] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"9d23e4183ff91351694a7d65","created_at":"2026-08-11T10:10:04.000Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb6436d4b7faac1789758869dda3937e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.037Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-9d23e4183ff91351694a7d65: start","job_status":"start","queue_duration_s":0.141,"scheduling_latency_s":0.141021} gitlab # [ 168.835043] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.200Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"9d23e4183ff91351694a7d65","created_at":"2026-08-11T10:10:04.000Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb6436d4b7faac1789758869dda3937e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.037Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-9d23e4183ff91351694a7d65: done: 0.02267 sec","job_status":"done","queue_duration_s":0.141,"scheduling_latency_s":0.141021,"redis_calls":12,"redis_duration_s":0.002938,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000436,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00149,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000474641,"exclusive_lock_hold_duration_s":0.004107506,"duration_s":0.02267,"completed_at":"2026-08-11T10:10:04.200Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002437,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 168.956688] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.232Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"08473d5e66486bed309dcd84","created_at":"2026-08-11T10:10:04.067Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11067f119641e7c2276e14082a128038","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.230Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-08473d5e66486bed309dcd84: start","job_status":"start","queue_duration_s":0.001896,"scheduling_latency_s":0.001927} gitlab # [ 168.958448] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.289Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"08473d5e66486bed309dcd84","created_at":"2026-08-11T10:10:04.067Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11067f119641e7c2276e14082a128038","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.230Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-08473d5e66486bed309dcd84: done: 0.05771 sec","job_status":"done","queue_duration_s":0.001896,"scheduling_latency_s":0.001927,"redis_calls":20,"redis_duration_s":0.020245,"redis_read_bytes":21,"redis_write_bytes":4317,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.009344,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.001975,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2022,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.007237,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001689,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000533028,"duration_s":0.05771,"completed_at":"2026-08-11T10:10:04.289Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002596,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 168.990214] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.293Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8ffc5e1ceb7092e13f1093ba","created_at":"2026-08-11T10:10:04.236Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.246Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8ffc5e1ceb7092e13f1093ba: start","job_status":"start","queue_duration_s":0.046347,"scheduling_latency_s":0.046372} gitlab # [ 169.033362] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.650Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8ffc5e1ceb7092e13f1093ba","created_at":"2026-08-11T10:10:04.236Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.246Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8ffc5e1ceb7092e13f1093ba: done: 0.356507 sec","job_status":"done","queue_duration_s":0.046347,"scheduling_latency_s":0.046372,"redis_calls":71,"redis_duration_s":0.101773,"redis_read_bytes":120,"redis_write_bytes":42574,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.010531,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001019,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.08562,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.004603,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.068,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.068,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.09196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000395023,"duration_s":0.356507,"completed_at":"2026-08-11T10:10:04.649Z","load_balancing_strategy":"primary","db_duration_s":0.067514,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 169.084233] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.655Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"e0d26a7f1956802880bd2c8f","created_at":"2026-08-11T10:10:04.253Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-68404b9ed90d404f","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"11067f119641e7c2276e14082a128038","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.269Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-e0d26a7f1956802880bd2c8f: start","job_status":"start","queue_duration_s":0.385757,"scheduling_latency_s":0.385803} gitlab # [ 169.187677] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.804Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"e0d26a7f1956802880bd2c8f","created_at":"2026-08-11T10:10:04.253Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-68404b9ed90d404f","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"11067f119641e7c2276e14082a128038","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.269Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-e0d26a7f1956802880bd2c8f: done: 0.14919 sec","job_status":"done","queue_duration_s":0.385757,"scheduling_latency_s":0.385803,"redis_calls":10,"redis_duration_s":0.008350999999999999,"redis_read_bytes":9,"redis_write_bytes":1117,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000471,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":222,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000392787,"duration_s":0.14919,"completed_at":"2026-08-11T10:10:04.804Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.111964,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 169.190836] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.808Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6976c32eca149cc43dc34cf0","created_at":"2026-08-11T10:10:04.263Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7b481f51756e9a30c154dfe372d58c6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.273Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6976c32eca149cc43dc34cf0: start","job_status":"start","queue_duration_s":0.534919,"scheduling_latency_s":0.534943} gitlab # [ 169.271135] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6976c32eca149cc43dc34cf0","created_at":"2026-08-11T10:10:04.263Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7b481f51756e9a30c154dfe372d58c6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.273Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6976c32eca149cc43dc34cf0: done: 0.028011 sec","job_status":"done","queue_duration_s":0.534919,"scheduling_latency_s":0.534943,"redis_calls":10,"redis_duration_s":0.0023970000000000003,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000439,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001453,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000505,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000367365,"duration_s":0.028011,"completed_at":"2026-08-11T10:10:04.835Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000539,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 169.273151] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.837Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"da0181ac29a25d4a39b89600","created_at":"2026-08-11T10:10:04.270Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-68404b9ed90d404f","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"11067f119641e7c2276e14082a128038","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.275Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-da0181ac29a25d4a39b89600: start","job_status":"start","queue_duration_s":0.561787,"scheduling_latency_s":0.561852} gitlab # [ 169.375943] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.992Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"da0181ac29a25d4a39b89600","created_at":"2026-08-11T10:10:04.270Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-68404b9ed90d404f","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"11067f119641e7c2276e14082a128038","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.275Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-da0181ac29a25d4a39b89600: done: 0.155488 sec","job_status":"done","queue_duration_s":0.561787,"scheduling_latency_s":0.561852,"redis_calls":10,"redis_duration_s":0.002656,"redis_read_bytes":9,"redis_write_bytes":1133,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000504,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001656,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000496,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.135,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.134,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000374629,"duration_s":0.155488,"completed_at":"2026-08-11T10:10:04.992Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.134746,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 169.377428] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:04.994Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"b4870f31ebe44ede91dbd339","created_at":"2026-08-11T10:10:04.281Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98a4dbee39a74633ed41c8815d59b157","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T10:10:04.304Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-b4870f31ebe44ede91dbd339: start","job_status":"start","queue_duration_s":0.690206,"scheduling_latency_s":0.690229} gitlab # [ 169.403742] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:05.020Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"b4870f31ebe44ede91dbd339","created_at":"2026-08-11T10:10:04.281Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98a4dbee39a74633ed41c8815d59b157","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T10:10:04.304Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-b4870f31ebe44ede91dbd339: done: 0.026246 sec","job_status":"done","queue_duration_s":0.690206,"scheduling_latency_s":0.690229,"redis_calls":10,"redis_duration_s":0.002359,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000435,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001452,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000472,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000403962,"duration_s":0.026246,"completed_at":"2026-08-11T10:10:05.020Z","load_balancing_strategy":"primary","db_duration_s":0.003235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 169.458358] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:05.022Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2e0cf97c936fdcc1d2f098c1","created_at":"2026-08-11T10:10:04.356Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ca9f802eae88c7405b2a2cbc0ed3396","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.366Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2e0cf97c936fdcc1d2f098c1: start","job_status":"start","queue_duration_s":0.655554,"scheduling_latency_s":0.655583} gitlab # [ 169.481408] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:05.034Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 169.487048] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:05.040Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2e0cf97c936fdcc1d2f098c1","created_at":"2026-08-11T10:10:04.356Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ca9f802eae88c7405b2a2cbc0ed3396","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.366Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2e0cf97c936fdcc1d2f098c1: done: 0.01824 sec","job_status":"done","queue_duration_s":0.655554,"scheduling_latency_s":0.655583,"redis_calls":10,"redis_duration_s":0.00226,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000437,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001392,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000431,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000368483,"duration_s":0.01824,"completed_at":"2026-08-11T10:10:05.040Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00199,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 169.585772] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:05.041Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"ea639415723232bc4ba6c5b3","created_at":"2026-08-11T10:10:04.370Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c83e06b31e3136e391c36f6fc00fd2d4","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.381Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-ea639415723232bc4ba6c5b3: start","job_status":"start","queue_duration_s":0.660704,"scheduling_latency_s":0.660725} gitlab # [ 169.587214] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:05.069Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"ea639415723232bc4ba6c5b3","created_at":"2026-08-11T10:10:04.370Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c83e06b31e3136e391c36f6fc00fd2d4","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.381Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-ea639415723232bc4ba6c5b3: done: 0.027307 sec","job_status":"done","queue_duration_s":0.660704,"scheduling_latency_s":0.660725,"redis_calls":17,"redis_duration_s":0.0041,"redis_read_bytes":15,"redis_write_bytes":2007,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001869,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1150,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001469,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000298,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000357028,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.027307,"completed_at":"2026-08-11T10:10:05.069Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004059,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 169.643413] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:05.070Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"cc48af3d82a066a4d5e2d706","created_at":"2026-08-11T10:10:04.393Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8147d7b77fb1c213c50b7e913b8dde33","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T10:10:04.405Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-cc48af3d82a066a4d5e2d706: start","job_status":"start","queue_duration_s":0.665507,"scheduling_latency_s":0.665528} gitlab # [ 169.726976] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:05.081Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 169.728347] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:05.088Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"cc48af3d82a066a4d5e2d706","created_at":"2026-08-11T10:10:04.393Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8147d7b77fb1c213c50b7e913b8dde33","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T10:10:04.405Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-cc48af3d82a066a4d5e2d706: done: 0.017824 sec","job_status":"done","queue_duration_s":0.665507,"scheduling_latency_s":0.665528,"redis_calls":10,"redis_duration_s":0.0024939999999999997,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000412,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001607,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000475,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000411505,"duration_s":0.017824,"completed_at":"2026-08-11T10:10:05.088Z","load_balancing_strategy":"primary","db_duration_s":0.0004,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 169.733210] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:05.090Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a1a7dedf348ffb8681a09068","created_at":"2026-08-11T10:10:04.417Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ebef240929851e260ce96ecf688481e2","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.426Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a1a7dedf348ffb8681a09068: start","job_status":"start","queue_duration_s":0.663518,"scheduling_latency_s":0.663538} gitlab # [ 169.907931] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:05.524Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a1a7dedf348ffb8681a09068","created_at":"2026-08-11T10:10:04.417Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ebef240929851e260ce96ecf688481e2","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.426Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a1a7dedf348ffb8681a09068: done: 0.434701 sec","job_status":"done","queue_duration_s":0.663518,"scheduling_latency_s":0.663538,"redis_calls":565,"redis_duration_s":0.135065,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000412,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001896,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.132757,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.328374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000534704,"duration_s":0.434701,"completed_at":"2026-08-11T10:10:05.524Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000388,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 170.001976] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:05.617Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f2b094a3cff45c0397460498","created_at":"2026-08-11T10:10:04.434Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f482dec172f534146b22f6549f516a67","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.442Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f2b094a3cff45c0397460498: start","job_status":"start","queue_duration_s":1.17534,"scheduling_latency_s":1.175386} gitlab # [ 170.069704] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:05.686Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f2b094a3cff45c0397460498","created_at":"2026-08-11T10:10:04.434Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f482dec172f534146b22f6549f516a67","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.442Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f2b094a3cff45c0397460498: done: 0.068821 sec","job_status":"done","queue_duration_s":1.17534,"scheduling_latency_s":1.175386,"redis_calls":14,"redis_duration_s":0.005772,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001748,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002229,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001795,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000735289,"exclusive_lock_hold_duration_s":0.042391142,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.068821,"completed_at":"2026-08-11T10:10:05.686Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015042,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 170.142465] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:05.759Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"f175d7779b9255e1bc60f3aa","created_at":"2026-08-11T10:10:04.445Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3059386554aaad453fb160224c93c5cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.452Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-f175d7779b9255e1bc60f3aa: start","job_status":"start","queue_duration_s":1.306779,"scheduling_latency_s":1.306849} gitlab # [ 170.444756] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.061Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"f175d7779b9255e1bc60f3aa","created_at":"2026-08-11T10:10:04.445Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3059386554aaad453fb160224c93c5cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.452Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-f175d7779b9255e1bc60f3aa: done: 0.302667 sec","job_status":"done","queue_duration_s":1.306779,"scheduling_latency_s":1.306849,"redis_calls":14,"redis_duration_s":0.006868,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001818,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002729,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002321,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.058,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.058,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.19385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001090362,"exclusive_lock_hold_duration_s":0.241337098,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.302667,"completed_at":"2026-08-11T10:10:06.061Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.092901,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 170.550231] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.166Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"6c69e117e105f43f295d0312","created_at":"2026-08-11T10:10:04.456Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"434a7655379ceb1380f414cd029bcaee","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.463Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-6c69e117e105f43f295d0312: start","job_status":"start","queue_duration_s":1.70266,"scheduling_latency_s":1.702733} gitlab # [ 170.624474] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.240Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"6c69e117e105f43f295d0312","created_at":"2026-08-11T10:10:04.456Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"434a7655379ceb1380f414cd029bcaee","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.463Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-6c69e117e105f43f295d0312: done: 0.07459 sec","job_status":"done","queue_duration_s":1.70266,"scheduling_latency_s":1.702733,"redis_calls":10,"redis_duration_s":0.004661,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000965,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002625,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001071,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000815746,"duration_s":0.07459,"completed_at":"2026-08-11T10:10:06.240Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006696,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 170.702974] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.319Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"62381924a84171a2728dbc02","created_at":"2026-08-11T10:10:04.470Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d545e2196b801548f10cb091dc2c0a60","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.478Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-62381924a84171a2728dbc02: start","job_status":"start","queue_duration_s":1.841183,"scheduling_latency_s":1.841256} gitlab # [ 170.752808] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.369Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"62381924a84171a2728dbc02","created_at":"2026-08-11T10:10:04.470Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d545e2196b801548f10cb091dc2c0a60","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.478Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-62381924a84171a2728dbc02: done: 0.050245 sec","job_status":"done","queue_duration_s":1.841183,"scheduling_latency_s":1.841256,"redis_calls":12,"redis_duration_s":0.008001000000000001,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.001267,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001557,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00395,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001227,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001141486,"duration_s":0.050245,"completed_at":"2026-08-11T10:10:06.369Z","load_balancing_strategy":"primary","db_duration_s":0.000964,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 170.823199] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.439Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"d1347c701cb3a264e9344f62","created_at":"2026-08-11T10:10:04.481Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"70018a28cf577cd4fc86fceb0b09d5ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.487Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-d1347c701cb3a264e9344f62: start","job_status":"start","queue_duration_s":1.951843,"scheduling_latency_s":1.951913} gitlab # [ 170.853100] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.470Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 170.873154] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.489Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"d1347c701cb3a264e9344f62","created_at":"2026-08-11T10:10:04.481Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"70018a28cf577cd4fc86fceb0b09d5ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.487Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-d1347c701cb3a264e9344f62: done: 0.050045 sec","job_status":"done","queue_duration_s":1.951843,"scheduling_latency_s":1.951913,"redis_calls":10,"redis_duration_s":0.007235,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001107,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001337,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002025956,"duration_s":0.050045,"completed_at":"2026-08-11T10:10:06.489Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000898,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 170.878393] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.495Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"fdfbe0099142e20e09010027","created_at":"2026-08-11T10:10:04.501Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e78807caa1275f5050efdf8c65a9a97","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.508Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-fdfbe0099142e20e09010027: start","job_status":"start","queue_duration_s":1.986263,"scheduling_latency_s":1.986306} gitlab # [ 170.999766] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.615Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"fdfbe0099142e20e09010027","created_at":"2026-08-11T10:10:04.501Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e78807caa1275f5050efdf8c65a9a97","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.508Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-fdfbe0099142e20e09010027: done: 0.120722 sec","job_status":"done","queue_duration_s":1.986263,"scheduling_latency_s":1.986306,"redis_calls":13,"redis_duration_s":0.009637,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001162,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005108,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.003367,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.065,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.065,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001032534,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.120722,"completed_at":"2026-08-11T10:10:06.615Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.066987,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.072731] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.688Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"dfcd296ebd8c7dcdd09f80e3","created_at":"2026-08-11T10:10:04.512Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b35e30382679afd0c663345bae0f8320","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.525Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-dfcd296ebd8c7dcdd09f80e3: start","job_status":"start","queue_duration_s":2.162516,"scheduling_latency_s":2.162609} gitlab # [ 171.131970] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.748Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"dfcd296ebd8c7dcdd09f80e3","created_at":"2026-08-11T10:10:04.512Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b35e30382679afd0c663345bae0f8320","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.525Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-dfcd296ebd8c7dcdd09f80e3: done: 0.060395 sec","job_status":"done","queue_duration_s":2.162516,"scheduling_latency_s":2.162609,"redis_calls":10,"redis_duration_s":0.005957,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001298,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003343,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001316,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001038679,"duration_s":0.060395,"completed_at":"2026-08-11T10:10:06.748Z","load_balancing_strategy":"primary","db_duration_s":0.007779,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.199578] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.816Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"20c2c32eecd0f8a039847c99","created_at":"2026-08-11T10:10:04.529Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f2aa05cb121a594e936f1f2096b8e7d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.537Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-20c2c32eecd0f8a039847c99: start","job_status":"start","queue_duration_s":2.278767,"scheduling_latency_s":2.278837} gitlab # [ 171.286232] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.902Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"20c2c32eecd0f8a039847c99","created_at":"2026-08-11T10:10:04.529Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f2aa05cb121a594e936f1f2096b8e7d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.537Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-20c2c32eecd0f8a039847c99: done: 0.086124 sec","job_status":"done","queue_duration_s":2.278767,"scheduling_latency_s":2.278837,"redis_calls":12,"redis_duration_s":0.00811,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001251,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00396,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002899,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001490692,"exclusive_lock_hold_duration_s":0.022369883,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.086124,"completed_at":"2026-08-11T10:10:06.902Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023226,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.291930] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.908Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"9bc7c5c57f236632f672bb4d","created_at":"2026-08-11T10:10:04.546Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e22fff13e9efffe028fcb0b19bbeaad","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.560Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-9bc7c5c57f236632f672bb4d: start","job_status":"start","queue_duration_s":2.347905,"scheduling_latency_s":2.347948} gitlab # [ 171.338278] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.955Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"9bc7c5c57f236632f672bb4d","created_at":"2026-08-11T10:10:04.546Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e22fff13e9efffe028fcb0b19bbeaad","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.560Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-9bc7c5c57f236632f672bb4d: done: 0.046418 sec","job_status":"done","queue_duration_s":2.347905,"scheduling_latency_s":2.347948,"redis_calls":13,"redis_duration_s":0.008793,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001838,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003696,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003259,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.010496027,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.046418,"completed_at":"2026-08-11T10:10:06.955Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007046,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 171.399698] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.962Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"054f69f6f8f0032ca3a2a213","created_at":"2026-08-11T10:10:04.568Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddfab07d429a88c1800fc6553059e544","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.577Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-054f69f6f8f0032ca3a2a213: start","job_status":"start","queue_duration_s":2.384227,"scheduling_latency_s":2.384251} gitlab # [ 171.419484] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.991Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"054f69f6f8f0032ca3a2a213","created_at":"2026-08-11T10:10:04.568Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddfab07d429a88c1800fc6553059e544","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.577Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-054f69f6f8f0032ca3a2a213: done: 0.029231 sec","job_status":"done","queue_duration_s":2.384227,"scheduling_latency_s":2.384251,"redis_calls":10,"redis_duration_s":0.007318,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001138,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004573,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001607,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00109986,"duration_s":0.029231,"completed_at":"2026-08-11T10:10:06.991Z","load_balancing_strategy":"primary","db_duration_s":0.003388,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.516233] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:06.994Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2445a802ceb45d52613499b4","created_at":"2026-08-11T10:10:04.584Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19a52277aa438098eaaff0947efad5e9","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.591Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2445a802ceb45d52613499b4: start","job_status":"start","queue_duration_s":2.403762,"scheduling_latency_s":2.403786} gitlab # [ 171.517835] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.023Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2445a802ceb45d52613499b4","created_at":"2026-08-11T10:10:04.584Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19a52277aa438098eaaff0947efad5e9","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.591Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2445a802ceb45d52613499b4: done: 0.028564 sec","job_status":"done","queue_duration_s":2.403762,"scheduling_latency_s":2.403786,"redis_calls":12,"redis_duration_s":0.00849,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001201,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004698,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002591,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000507048,"exclusive_lock_hold_duration_s":0.003917536,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.028564,"completed_at":"2026-08-11T10:10:07.023Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002889,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.572186] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.026Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"3f54150db016d64230b67343","created_at":"2026-08-11T10:10:04.619Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e1f26e59bc030f3e7f64deb7cc20dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.626Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-3f54150db016d64230b67343: start","job_status":"start","queue_duration_s":2.400074,"scheduling_latency_s":2.400095} gitlab # [ 171.657683] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.063Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"3f54150db016d64230b67343","created_at":"2026-08-11T10:10:04.619Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e1f26e59bc030f3e7f64deb7cc20dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.626Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-3f54150db016d64230b67343: done: 0.036741 sec","job_status":"done","queue_duration_s":2.400074,"scheduling_latency_s":2.400095,"redis_calls":19,"redis_duration_s":0.010145999999999999,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002048,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000334,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00418,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003584,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000365968,"duration_s":0.036741,"completed_at":"2026-08-11T10:10:07.063Z","load_balancing_strategy":"primary","db_duration_s":0.002135,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.662172] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff883b419806660bfed136aa","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff883b419806660bfed136aa: start","job_status":"start","queue_duration_s":2.431449,"scheduling_latency_s":2.43147} gitlab # [ 171.684288] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff883b419806660bfed136aa","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff883b419806660bfed136aa: done: 0.022731 sec","job_status":"done","queue_duration_s":2.431449,"scheduling_latency_s":2.43147,"redis_calls":16,"redis_duration_s":0.003822,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000474,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001163,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002185,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000363454,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022731,"completed_at":"2026-08-11T10:10:07.087Z","load_balancing_strategy":"primary","db_duration_s":0.000337,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.764341] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5eb74ad6b89dc95f506d371","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5eb74ad6b89dc95f506d371: start","job_status":"start","queue_duration_s":2.455678,"scheduling_latency_s":2.455699} gitlab # [ 171.768338] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5eb74ad6b89dc95f506d371","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5eb74ad6b89dc95f506d371: done: 0.016459 sec","job_status":"done","queue_duration_s":2.455678,"scheduling_latency_s":2.455699,"redis_calls":13,"redis_duration_s":0.003031,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016459,"completed_at":"2026-08-11T10:10:07.105Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.822402] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"590ff3c509badce49d9a4408","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-590ff3c509badce49d9a4408: start","job_status":"start","queue_duration_s":2.473438,"scheduling_latency_s":2.473459} gitlab # [ 171.841949] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"590ff3c509badce49d9a4408","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-590ff3c509badce49d9a4408: done: 0.016345 sec","job_status":"done","queue_duration_s":2.473438,"scheduling_latency_s":2.473459,"redis_calls":13,"redis_duration_s":0.0034019999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001041,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002361,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016345,"completed_at":"2026-08-11T10:10:07.123Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.904102] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"522362738a71d73b3ba43ca8","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-522362738a71d73b3ba43ca8: start","job_status":"start","queue_duration_s":2.491145,"scheduling_latency_s":2.491167} gitlab # [ 171.924135] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"522362738a71d73b3ba43ca8","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-522362738a71d73b3ba43ca8: done: 0.015807 sec","job_status":"done","queue_duration_s":2.491145,"scheduling_latency_s":2.491167,"redis_calls":13,"redis_duration_s":0.0028729999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015807,"completed_at":"2026-08-11T10:10:07.140Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 171.986414] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52414d2e9ae286663b270600","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52414d2e9ae286663b270600: start","job_status":"start","queue_duration_s":2.508439,"scheduling_latency_s":2.508461} gitlab # [ 172.005980] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52414d2e9ae286663b270600","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52414d2e9ae286663b270600: done: 0.015814 sec","job_status":"done","queue_duration_s":2.508439,"scheduling_latency_s":2.508461,"redis_calls":13,"redis_duration_s":0.002988,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015814,"completed_at":"2026-08-11T10:10:07.158Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.085768] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dff90f695e02626f51bb5a78","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dff90f695e02626f51bb5a78: start","job_status":"start","queue_duration_s":2.525773,"scheduling_latency_s":2.525794} gitlab # [ 172.087174] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dff90f695e02626f51bb5a78","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dff90f695e02626f51bb5a78: done: 0.01577 sec","job_status":"done","queue_duration_s":2.525773,"scheduling_latency_s":2.525794,"redis_calls":13,"redis_duration_s":0.002938,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01577,"completed_at":"2026-08-11T10:10:07.175Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.147319] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5364daa4d3d24f3f4db0e33e","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5364daa4d3d24f3f4db0e33e: start","job_status":"start","queue_duration_s":2.543081,"scheduling_latency_s":2.543104} gitlab # [ 172.226707] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5364daa4d3d24f3f4db0e33e","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5364daa4d3d24f3f4db0e33e: done: 0.015778 sec","job_status":"done","queue_duration_s":2.543081,"scheduling_latency_s":2.543104,"redis_calls":13,"redis_duration_s":0.002929,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00197,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015778,"completed_at":"2026-08-11T10:10:07.192Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.228914] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8643da0f3952f5f8a30a2212","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8643da0f3952f5f8a30a2212: start","job_status":"start","queue_duration_s":2.560354,"scheduling_latency_s":2.560377} gitlab # [ 172.246098] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8643da0f3952f5f8a30a2212","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8643da0f3952f5f8a30a2212: done: 0.015879 sec","job_status":"done","queue_duration_s":2.560354,"scheduling_latency_s":2.560377,"redis_calls":13,"redis_duration_s":0.003056,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015879,"completed_at":"2026-08-11T10:10:07.209Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.308246] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3e0fc68090c978e1f2e7fb8","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3e0fc68090c978e1f2e7fb8: start","job_status":"start","queue_duration_s":2.578012,"scheduling_latency_s":2.578034} gitlab # [ 172.328127] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3e0fc68090c978e1f2e7fb8","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3e0fc68090c978e1f2e7fb8: done: 0.016255 sec","job_status":"done","queue_duration_s":2.578012,"scheduling_latency_s":2.578034,"redis_calls":13,"redis_duration_s":0.003253,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001195,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016255,"completed_at":"2026-08-11T10:10:07.228Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.390059] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"000e2f55a0841ca450ac8246","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-000e2f55a0841ca450ac8246: start","job_status":"start","queue_duration_s":2.5956,"scheduling_latency_s":2.595622} gitlab # [ 172.409350] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"000e2f55a0841ca450ac8246","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-000e2f55a0841ca450ac8246: done: 0.015965 sec","job_status":"done","queue_duration_s":2.5956,"scheduling_latency_s":2.595622,"redis_calls":13,"redis_duration_s":0.00309,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000969,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015965,"completed_at":"2026-08-11T10:10:07.245Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.512477] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0782a631e3350cf6a95bd13b","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0782a631e3350cf6a95bd13b: start","job_status":"start","queue_duration_s":2.61295,"scheduling_latency_s":2.612973} gitlab # [ 172.514073] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0782a631e3350cf6a95bd13b","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0782a631e3350cf6a95bd13b: done: 0.016108 sec","job_status":"done","queue_duration_s":2.61295,"scheduling_latency_s":2.612973,"redis_calls":13,"redis_duration_s":0.003031,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016108,"completed_at":"2026-08-11T10:10:07.262Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.550348] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36ea870cd8dfdd1e986c74cb","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36ea870cd8dfdd1e986c74cb: start","job_status":"start","queue_duration_s":2.630393,"scheduling_latency_s":2.630414} gitlab # [ 172.570344] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36ea870cd8dfdd1e986c74cb","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36ea870cd8dfdd1e986c74cb: done: 0.015973 sec","job_status":"done","queue_duration_s":2.630393,"scheduling_latency_s":2.630414,"redis_calls":13,"redis_duration_s":0.00328,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002423,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015973,"completed_at":"2026-08-11T10:10:07.280Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.655389] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"126ff56be94b09898f98b4b7","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-126ff56be94b09898f98b4b7: start","job_status":"start","queue_duration_s":2.647737,"scheduling_latency_s":2.647757} gitlab # [ 172.657250] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"126ff56be94b09898f98b4b7","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-126ff56be94b09898f98b4b7: done: 0.015843 sec","job_status":"done","queue_duration_s":2.647737,"scheduling_latency_s":2.647757,"redis_calls":13,"redis_duration_s":0.002861,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015843,"completed_at":"2026-08-11T10:10:07.297Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.712777] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94f6aa09accfc34f2e63f147","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94f6aa09accfc34f2e63f147: start","job_status":"start","queue_duration_s":2.66497,"scheduling_latency_s":2.664991} gitlab # [ 172.797422] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94f6aa09accfc34f2e63f147","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94f6aa09accfc34f2e63f147: done: 0.015861 sec","job_status":"done","queue_duration_s":2.66497,"scheduling_latency_s":2.664991,"redis_calls":13,"redis_duration_s":0.003127,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001176,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015861,"completed_at":"2026-08-11T10:10:07.314Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.799191] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7dec38b06f9e2e4b78167054","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7dec38b06f9e2e4b78167054: start","job_status":"start","queue_duration_s":2.682381,"scheduling_latency_s":2.682402} gitlab # [ 172.811328] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7dec38b06f9e2e4b78167054","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7dec38b06f9e2e4b78167054: done: 0.016671 sec","job_status":"done","queue_duration_s":2.682381,"scheduling_latency_s":2.682402,"redis_calls":13,"redis_duration_s":0.003104,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00219,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016671,"completed_at":"2026-08-11T10:10:07.332Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.938405] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90af3720655c26f86b1888b0","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90af3720655c26f86b1888b0: start","job_status":"start","queue_duration_s":2.700552,"scheduling_latency_s":2.700575} gitlab # [ 172.939974] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90af3720655c26f86b1888b0","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90af3720655c26f86b1888b0: done: 0.015836 sec","job_status":"done","queue_duration_s":2.700552,"scheduling_latency_s":2.700575,"redis_calls":13,"redis_duration_s":0.0028599999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015836,"completed_at":"2026-08-11T10:10:07.350Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 172.953328] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a3c5dec2f6475cb6824e3cf","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a3c5dec2f6475cb6824e3cf: start","job_status":"start","queue_duration_s":2.718588,"scheduling_latency_s":2.71861} gitlab # [ 172.973117] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a3c5dec2f6475cb6824e3cf","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a3c5dec2f6475cb6824e3cf: done: 0.016264 sec","job_status":"done","queue_duration_s":2.718588,"scheduling_latency_s":2.71861,"redis_calls":13,"redis_duration_s":0.0030960000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001043,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016264,"completed_at":"2026-08-11T10:10:07.368Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.081877] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a955096c4cab9cf7d336795","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a955096c4cab9cf7d336795: start","job_status":"start","queue_duration_s":2.736386,"scheduling_latency_s":2.736409} gitlab # [ 173.083367] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a955096c4cab9cf7d336795","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a955096c4cab9cf7d336795: done: 0.015665 sec","job_status":"done","queue_duration_s":2.736386,"scheduling_latency_s":2.736409,"redis_calls":13,"redis_duration_s":0.0029690000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015665,"completed_at":"2026-08-11T10:10:07.385Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.115582] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9baf64dde5847b78d4abbb12","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9baf64dde5847b78d4abbb12: start","job_status":"start","queue_duration_s":2.753833,"scheduling_latency_s":2.753856} gitlab # [ 173.134964] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9baf64dde5847b78d4abbb12","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9baf64dde5847b78d4abbb12: done: 0.015667 sec","job_status":"done","queue_duration_s":2.753833,"scheduling_latency_s":2.753856,"redis_calls":13,"redis_duration_s":0.0029289999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000957,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015667,"completed_at":"2026-08-11T10:10:07.403Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.210183] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81985016979e14fb92f68524","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81985016979e14fb92f68524: start","job_status":"start","queue_duration_s":2.770914,"scheduling_latency_s":2.770935} gitlab # [ 173.214274] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81985016979e14fb92f68524","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81985016979e14fb92f68524: done: 0.016156 sec","job_status":"done","queue_duration_s":2.770914,"scheduling_latency_s":2.770935,"redis_calls":13,"redis_duration_s":0.003131,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001173,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016156,"completed_at":"2026-08-11T10:10:07.420Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.282234] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6d5f88ad20c847540d7a2d9","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6d5f88ad20c847540d7a2d9: start","job_status":"start","queue_duration_s":2.788383,"scheduling_latency_s":2.788405} gitlab # [ 173.296216] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6d5f88ad20c847540d7a2d9","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6d5f88ad20c847540d7a2d9: done: 0.015883 sec","job_status":"done","queue_duration_s":2.788383,"scheduling_latency_s":2.788405,"redis_calls":13,"redis_duration_s":0.0030940000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000871,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002223,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015883,"completed_at":"2026-08-11T10:10:07.438Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.366117] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77e8338dbb838d0cf03dc53d","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77e8338dbb838d0cf03dc53d: start","job_status":"start","queue_duration_s":2.805595,"scheduling_latency_s":2.805618} gitlab # [ 173.375237] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77e8338dbb838d0cf03dc53d","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77e8338dbb838d0cf03dc53d: done: 0.01588 sec","job_status":"done","queue_duration_s":2.805595,"scheduling_latency_s":2.805618,"redis_calls":13,"redis_duration_s":0.003013,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01588,"completed_at":"2026-08-11T10:10:07.455Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.437113] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4323b199c9ee47f959041629","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4323b199c9ee47f959041629: start","job_status":"start","queue_duration_s":2.822822,"scheduling_latency_s":2.822844} gitlab # [ 173.506266] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4323b199c9ee47f959041629","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4323b199c9ee47f959041629: done: 0.015663 sec","job_status":"done","queue_duration_s":2.822822,"scheduling_latency_s":2.822844,"redis_calls":13,"redis_duration_s":0.002864,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015663,"completed_at":"2026-08-11T10:10:07.472Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.516177] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d1ac932192ecde3776e7754","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d1ac932192ecde3776e7754: start","job_status":"start","queue_duration_s":2.839941,"scheduling_latency_s":2.839963} gitlab # [ 173.535515] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d1ac932192ecde3776e7754","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d1ac932192ecde3776e7754: done: 0.01565 sec","job_status":"done","queue_duration_s":2.839941,"scheduling_latency_s":2.839963,"redis_calls":13,"redis_duration_s":0.002959,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01565,"completed_at":"2026-08-11T10:10:07.489Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.597481] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43ee5a4f2bf853afbaa7f9d5","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43ee5a4f2bf853afbaa7f9d5: start","job_status":"start","queue_duration_s":2.857146,"scheduling_latency_s":2.857166} gitlab # [ 173.617262] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43ee5a4f2bf853afbaa7f9d5","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43ee5a4f2bf853afbaa7f9d5: done: 0.015757 sec","job_status":"done","queue_duration_s":2.857146,"scheduling_latency_s":2.857166,"redis_calls":13,"redis_duration_s":0.002861,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000874,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015757,"completed_at":"2026-08-11T10:10:07.506Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.678913] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"095acc4d58ced5c0e2087a28","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-095acc4d58ced5c0e2087a28: start","job_status":"start","queue_duration_s":2.874435,"scheduling_latency_s":2.874457} gitlab # [ 173.698205] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"095acc4d58ced5c0e2087a28","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-095acc4d58ced5c0e2087a28: done: 0.016075 sec","job_status":"done","queue_duration_s":2.874435,"scheduling_latency_s":2.874457,"redis_calls":13,"redis_duration_s":0.003286,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002337,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016075,"completed_at":"2026-08-11T10:10:07.524Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.791671] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94683ef2d0e382ca77e1e1eb","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94683ef2d0e382ca77e1e1eb: start","job_status":"start","queue_duration_s":2.892024,"scheduling_latency_s":2.892044} gitlab # [ 173.793573] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94683ef2d0e382ca77e1e1eb","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94683ef2d0e382ca77e1e1eb: done: 0.015553 sec","job_status":"done","queue_duration_s":2.892024,"scheduling_latency_s":2.892044,"redis_calls":13,"redis_duration_s":0.002859,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015553,"completed_at":"2026-08-11T10:10:07.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.840933] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c80023d673a39df0dbd2f5ff","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c80023d673a39df0dbd2f5ff: start","job_status":"start","queue_duration_s":2.909155,"scheduling_latency_s":2.909177} gitlab # [ 173.860641] setup-gitlab-start[2302]: W, [2026-08-11T10:10:09.385962 #2302] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 173.863290] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c80023d673a39df0dbd2f5ff","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c80023d673a39df0dbd2f5ff: done: 0.015692 sec","job_status":"done","queue_duration_s":2.909155,"scheduling_latency_s":2.909177,"redis_calls":13,"redis_duration_s":0.0028859999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015692,"completed_at":"2026-08-11T10:10:07.558Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 173.934406] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddd1d1b650f32e6ed5bcff94","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddd1d1b650f32e6ed5bcff94: start","job_status":"start","queue_duration_s":2.926316,"scheduling_latency_s":2.926339} gitlab # [ 173.942410] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddd1d1b650f32e6ed5bcff94","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddd1d1b650f32e6ed5bcff94: done: 0.015627 sec","job_status":"done","queue_duration_s":2.926316,"scheduling_latency_s":2.926339,"redis_calls":13,"redis_duration_s":0.0030369999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00199,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015627,"completed_at":"2026-08-11T10:10:07.575Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.004422] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc45c1710f29f898a0ef4189","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc45c1710f29f898a0ef4189: start","job_status":"start","queue_duration_s":2.943273,"scheduling_latency_s":2.943293} gitlab # [ 174.075189] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc45c1710f29f898a0ef4189","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc45c1710f29f898a0ef4189: done: 0.015793 sec","job_status":"done","queue_duration_s":2.943273,"scheduling_latency_s":2.943293,"redis_calls":13,"redis_duration_s":0.003051,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015793,"completed_at":"2026-08-11T10:10:07.592Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.083051] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f969dd8acea7beb6e5120c2","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f969dd8acea7beb6e5120c2: start","job_status":"start","queue_duration_s":2.960462,"scheduling_latency_s":2.960484} gitlab # [ 174.102943] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f969dd8acea7beb6e5120c2","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f969dd8acea7beb6e5120c2: done: 0.016068 sec","job_status":"done","queue_duration_s":2.960462,"scheduling_latency_s":2.960484,"redis_calls":13,"redis_duration_s":0.003175,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002249,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016068,"completed_at":"2026-08-11T10:10:07.610Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.216582] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9be12a0f2c692f3ca77c3b7","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9be12a0f2c692f3ca77c3b7: start","job_status":"start","queue_duration_s":2.977902,"scheduling_latency_s":2.977925} gitlab # [ 174.217981] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9be12a0f2c692f3ca77c3b7","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9be12a0f2c692f3ca77c3b7: done: 0.016205 sec","job_status":"done","queue_duration_s":2.977902,"scheduling_latency_s":2.977925,"redis_calls":13,"redis_duration_s":0.0030080000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016205,"completed_at":"2026-08-11T10:10:07.627Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.243414] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.629Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d764cde481056514fd13a84c","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d764cde481056514fd13a84c: start","job_status":"start","queue_duration_s":2.995425,"scheduling_latency_s":2.995446} gitlab # [ 174.263347] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d764cde481056514fd13a84c","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d764cde481056514fd13a84c: done: 0.0159 sec","job_status":"done","queue_duration_s":2.995425,"scheduling_latency_s":2.995446,"redis_calls":13,"redis_duration_s":0.0031269999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000874,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002253,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0159,"completed_at":"2026-08-11T10:10:07.645Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.325242] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3baadba2cffb12640616a1e3","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3baadba2cffb12640616a1e3: start","job_status":"start","queue_duration_s":3.012691,"scheduling_latency_s":3.012714} gitlab # [ 174.345295] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3baadba2cffb12640616a1e3","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3baadba2cffb12640616a1e3: done: 0.015751 sec","job_status":"done","queue_duration_s":3.012691,"scheduling_latency_s":3.012714,"redis_calls":13,"redis_duration_s":0.003039,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000964,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002075,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015751,"completed_at":"2026-08-11T10:10:07.662Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.406823] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c9b6a1e4b65f1b11f941461","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c9b6a1e4b65f1b11f941461: start","job_status":"start","queue_duration_s":3.029919,"scheduling_latency_s":3.02994} gitlab # [ 174.426121] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c9b6a1e4b65f1b11f941461","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c9b6a1e4b65f1b11f941461: done: 0.015707 sec","job_status":"done","queue_duration_s":3.029919,"scheduling_latency_s":3.02994,"redis_calls":13,"redis_duration_s":0.003007,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015707,"completed_at":"2026-08-11T10:10:07.679Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.501321] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b979868e7d1fb74f5b5b2011","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b979868e7d1fb74f5b5b2011: start","job_status":"start","queue_duration_s":3.047117,"scheduling_latency_s":3.047138} gitlab # [ 174.505204] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b979868e7d1fb74f5b5b2011","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b979868e7d1fb74f5b5b2011: done: 0.015703 sec","job_status":"done","queue_duration_s":3.047117,"scheduling_latency_s":3.047138,"redis_calls":13,"redis_duration_s":0.002855,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015703,"completed_at":"2026-08-11T10:10:07.696Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.567293] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb202a8a8c7da3cae56aed58","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb202a8a8c7da3cae56aed58: start","job_status":"start","queue_duration_s":3.064281,"scheduling_latency_s":3.064302} gitlab # [ 174.642323] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb202a8a8c7da3cae56aed58","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb202a8a8c7da3cae56aed58: done: 0.015597 sec","job_status":"done","queue_duration_s":3.064281,"scheduling_latency_s":3.064302,"redis_calls":13,"redis_duration_s":0.0029100000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015597,"completed_at":"2026-08-11T10:10:07.713Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.646166] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.715Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79a2c7f53d2a805304aad85f","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79a2c7f53d2a805304aad85f: start","job_status":"start","queue_duration_s":3.081369,"scheduling_latency_s":3.081391} gitlab # [ 174.665513] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79a2c7f53d2a805304aad85f","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79a2c7f53d2a805304aad85f: done: 0.016124 sec","job_status":"done","queue_duration_s":3.081369,"scheduling_latency_s":3.081391,"redis_calls":13,"redis_duration_s":0.003177,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016124,"completed_at":"2026-08-11T10:10:07.731Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.783310] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"621bd935d956c49cdbea9a32","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-621bd935d956c49cdbea9a32: start","job_status":"start","queue_duration_s":3.099025,"scheduling_latency_s":3.099048} gitlab # [ 174.784607] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"621bd935d956c49cdbea9a32","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-621bd935d956c49cdbea9a32: done: 0.015657 sec","job_status":"done","queue_duration_s":3.099025,"scheduling_latency_s":3.099048,"redis_calls":13,"redis_duration_s":0.002845,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015657,"completed_at":"2026-08-11T10:10:07.748Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.806231] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95ae4e04018060403ee925cc","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95ae4e04018060403ee925cc: start","job_status":"start","queue_duration_s":3.116031,"scheduling_latency_s":3.116053} gitlab # [ 174.826167] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95ae4e04018060403ee925cc","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95ae4e04018060403ee925cc: done: 0.01571 sec","job_status":"done","queue_duration_s":3.116031,"scheduling_latency_s":3.116053,"redis_calls":13,"redis_duration_s":0.002978,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01571,"completed_at":"2026-08-11T10:10:07.765Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.925294] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d04e8d4873ca71cf5604308","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d04e8d4873ca71cf5604308: start","job_status":"start","queue_duration_s":3.133108,"scheduling_latency_s":3.133129} gitlab # [ 174.926886] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d04e8d4873ca71cf5604308","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d04e8d4873ca71cf5604308: done: 0.015877 sec","job_status":"done","queue_duration_s":3.133108,"scheduling_latency_s":3.133129,"redis_calls":13,"redis_duration_s":0.003082,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000983,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015877,"completed_at":"2026-08-11T10:10:07.782Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 174.967092] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a3a65020fcf14f2713948ad","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a3a65020fcf14f2713948ad: start","job_status":"start","queue_duration_s":3.15039,"scheduling_latency_s":3.150411} gitlab # [ 174.987044] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a3a65020fcf14f2713948ad","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a3a65020fcf14f2713948ad: done: 0.015822 sec","job_status":"done","queue_duration_s":3.15039,"scheduling_latency_s":3.150411,"redis_calls":13,"redis_duration_s":0.0032890000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001007,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002282,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015822,"completed_at":"2026-08-11T10:10:07.799Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 175.062364] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2ebd2d3a0750e446bbf501e","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2ebd2d3a0750e446bbf501e: start","job_status":"start","queue_duration_s":3.167554,"scheduling_latency_s":3.167575} gitlab # [ 175.067319] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2ebd2d3a0750e446bbf501e","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2ebd2d3a0750e446bbf501e: done: 0.015818 sec","job_status":"done","queue_duration_s":3.167554,"scheduling_latency_s":3.167575,"redis_calls":13,"redis_duration_s":0.003018,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015818,"completed_at":"2026-08-11T10:10:07.817Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 175.129536] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f35bb15dc95c5513075cd94b","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f35bb15dc95c5513075cd94b: start","job_status":"start","queue_duration_s":3.184744,"scheduling_latency_s":3.184765} gitlab # [ 175.210519] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f35bb15dc95c5513075cd94b","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f35bb15dc95c5513075cd94b: done: 0.016044 sec","job_status":"done","queue_duration_s":3.184744,"scheduling_latency_s":3.184765,"redis_calls":13,"redis_duration_s":0.0028840000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016044,"completed_at":"2026-08-11T10:10:07.834Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 175.213509] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"741a2397edaf2a26c450463a","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-741a2397edaf2a26c450463a: start","job_status":"start","queue_duration_s":3.202259,"scheduling_latency_s":3.202281} gitlab # [ 175.230281] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"741a2397edaf2a26c450463a","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-741a2397edaf2a26c450463a: done: 0.01571 sec","job_status":"done","queue_duration_s":3.202259,"scheduling_latency_s":3.202281,"redis_calls":13,"redis_duration_s":0.002937,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01571,"completed_at":"2026-08-11T10:10:07.851Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 175.291894] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5de72c91b62e2d57473c6355","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5de72c91b62e2d57473c6355: start","job_status":"start","queue_duration_s":3.21945,"scheduling_latency_s":3.219472} gitlab # [ 175.311249] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5de72c91b62e2d57473c6355","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5de72c91b62e2d57473c6355: done: 0.01572 sec","job_status":"done","queue_duration_s":3.21945,"scheduling_latency_s":3.219472,"redis_calls":13,"redis_duration_s":0.003004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002137,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01572,"completed_at":"2026-08-11T10:10:07.868Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 175.387035] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f711c0d2a86505c375f47939","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f711c0d2a86505c375f47939: start","job_status":"start","queue_duration_s":3.236731,"scheduling_latency_s":3.236752} gitlab # [ 175.390416] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f711c0d2a86505c375f47939","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f711c0d2a86505c375f47939: done: 0.015573 sec","job_status":"done","queue_duration_s":3.236731,"scheduling_latency_s":3.236752,"redis_calls":13,"redis_duration_s":0.002836,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015573,"completed_at":"2026-08-11T10:10:07.886Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 175.493924] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d062ba91f86e87cfbada4a5","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d062ba91f86e87cfbada4a5: start","job_status":"start","queue_duration_s":3.253823,"scheduling_latency_s":3.253846} gitlab # [ 175.495311] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d062ba91f86e87cfbada4a5","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d062ba91f86e87cfbada4a5: done: 0.015797 sec","job_status":"done","queue_duration_s":3.253823,"scheduling_latency_s":3.253846,"redis_calls":13,"redis_duration_s":0.002893,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015797,"completed_at":"2026-08-11T10:10:07.903Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 175.531959] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef6d56e7e8e29e4feb1689e0","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef6d56e7e8e29e4feb1689e0: start","job_status":"start","queue_duration_s":3.27115,"scheduling_latency_s":3.271171} gitlab # [ 175.551363] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef6d56e7e8e29e4feb1689e0","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef6d56e7e8e29e4feb1689e0: done: 0.015684 sec","job_status":"done","queue_duration_s":3.27115,"scheduling_latency_s":3.271171,"redis_calls":13,"redis_duration_s":0.002888,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015684,"completed_at":"2026-08-11T10:10:07.920Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 175.636177] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d12d59e4273e932ad061f323","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d12d59e4273e932ad061f323: start","job_status":"start","queue_duration_s":3.288364,"scheduling_latency_s":3.288386} gitlab # [ 175.637494] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d12d59e4273e932ad061f323","created_at":"2026-08-11T10:10:04.386Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-061da9b38e3d41c5","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7f6cdd4949668974ff063fdc48410ff8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.633Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d12d59e4273e932ad061f323: done: 0.016031 sec","job_status":"done","queue_duration_s":3.288364,"scheduling_latency_s":3.288386,"redis_calls":13,"redis_duration_s":0.002986,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000875,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016031,"completed_at":"2026-08-11T10:10:07.938Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 175.692259] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.939Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"e85284f55cbaf909f65399e8","created_at":"2026-08-11T10:10:04.631Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abaa0e6796bb0faeed83cb4aa3df7103","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.639Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-e85284f55cbaf909f65399e8: start","job_status":"start","queue_duration_s":3.299977,"scheduling_latency_s":3.299999} gitlab # [ 175.777411] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.967Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"e85284f55cbaf909f65399e8","created_at":"2026-08-11T10:10:04.631Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abaa0e6796bb0faeed83cb4aa3df7103","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.639Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-e85284f55cbaf909f65399e8: done: 0.028203 sec","job_status":"done","queue_duration_s":3.299977,"scheduling_latency_s":3.299999,"redis_calls":10,"redis_duration_s":0.002398,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000477,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000569,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000375187,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.028203,"completed_at":"2026-08-11T10:10:07.967Z","load_balancing_strategy":"primary","db_duration_s":0.008419,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 175.779110] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.969Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"635fc03a2edbf2456a05cab1","created_at":"2026-08-11T10:10:04.642Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98220fbc09762d888127cf83c4112981","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.658Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-635fc03a2edbf2456a05cab1: start","job_status":"start","queue_duration_s":3.310478,"scheduling_latency_s":3.310498} gitlab # [ 175.802465] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.980Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 175.808110] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.986Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"635fc03a2edbf2456a05cab1","created_at":"2026-08-11T10:10:04.642Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98220fbc09762d888127cf83c4112981","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.658Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-635fc03a2edbf2456a05cab1: done: 0.017218 sec","job_status":"done","queue_duration_s":3.310478,"scheduling_latency_s":3.310498,"redis_calls":10,"redis_duration_s":0.002356,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000471,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001417,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000362615,"duration_s":0.017218,"completed_at":"2026-08-11T10:10:07.986Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000336,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 175.919936] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:07.988Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"ebef4f396ace9f2497f97a87","created_at":"2026-08-11T10:10:04.663Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"812f8162b522f5e17aa8aa3ae1bc19e8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.675Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-ebef4f396ace9f2497f97a87: start","job_status":"start","queue_duration_s":3.312427,"scheduling_latency_s":3.312448} gitlab # [ 175.921326] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:08.007Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"ebef4f396ace9f2497f97a87","created_at":"2026-08-11T10:10:04.663Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"812f8162b522f5e17aa8aa3ae1bc19e8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.675Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-ebef4f396ace9f2497f97a87: done: 0.019963 sec","job_status":"done","queue_duration_s":3.312427,"scheduling_latency_s":3.312448,"redis_calls":10,"redis_duration_s":0.002209,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000425,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001344,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000361219,"duration_s":0.019963,"completed_at":"2026-08-11T10:10:08.007Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001607,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 175.961908] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:08.009Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"4b53dece03569e37f04c7527","created_at":"2026-08-11T10:10:04.686Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51eb92cdc08dcc9763b00afcad2aadde","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.692Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-4b53dece03569e37f04c7527: start","job_status":"start","queue_duration_s":3.317359,"scheduling_latency_s":3.31738} gitlab # [ 175.984282] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:08.031Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"4b53dece03569e37f04c7527","created_at":"2026-08-11T10:10:04.686Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-b8f8c41c198a4f4e","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51eb92cdc08dcc9763b00afcad2aadde","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:04.692Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-4b53dece03569e37f04c7527: done: 0.02164 sec","job_status":"done","queue_duration_s":3.317359,"scheduling_latency_s":3.31738,"redis_calls":10,"redis_duration_s":0.0023769999999999998,"redis_read_bytes":9,"redis_write_bytes":1109,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000476,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001432,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000469,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000398654,"duration_s":0.02164,"completed_at":"2026-08-11T10:10:08.031Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002764,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 176.061977] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:08.032Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"baf2f07fe31b64c06f7b0540","created_at":"2026-08-11T10:10:07.048Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-c38b30cd4a684b40","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5e1f26e59bc030f3e7f64deb7cc20dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:07.057Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-baf2f07fe31b64c06f7b0540: start","job_status":"start","queue_duration_s":0.975417,"scheduling_latency_s":0.975437} gitlab # [ 176.068052] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:08.082Z","message":"No existing merge request to be cleaned up."} gitlab # [ 176.070961] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:08.094Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"baf2f07fe31b64c06f7b0540","created_at":"2026-08-11T10:10:07.048Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-c38b30cd4a684b40","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5e1f26e59bc030f3e7f64deb7cc20dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:07.057Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-baf2f07fe31b64c06f7b0540: done: 0.061631 sec","job_status":"done","queue_duration_s":0.975417,"scheduling_latency_s":0.975437,"redis_calls":13,"redis_duration_s":0.003191,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000426,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001151,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001614,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.036,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.036,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037854,"duration_s":0.061631,"completed_at":"2026-08-11T10:10:08.094Z","load_balancing_strategy":"primary","db_duration_s":0.002961,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 176.134467] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:08.095Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c795aa97105727861dd3b506","created_at":"2026-08-11T10:10:07.048Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-c38b30cd4a684b40","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5e1f26e59bc030f3e7f64deb7cc20dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:07.057Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c795aa97105727861dd3b506: start","job_status":"start","queue_duration_s":1.038624,"scheduling_latency_s":1.038645} gitlab # [ 176.202912] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:08.106Z","message":"No existing merge request to be cleaned up."} gitlab # [ 176.204270] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:08.112Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c795aa97105727861dd3b506","created_at":"2026-08-11T10:10:07.048Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-c38b30cd4a684b40","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5e1f26e59bc030f3e7f64deb7cc20dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:07.057Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c795aa97105727861dd3b506: done: 0.016784 sec","job_status":"done","queue_duration_s":1.038624,"scheduling_latency_s":1.038645,"redis_calls":10,"redis_duration_s":0.002336,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001402,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016784,"completed_at":"2026-08-11T10:10:08.112Z","load_balancing_strategy":"primary","db_duration_s":0.001476,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 176.215204] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:08.114Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"acaf62e446191a91d5a0076e","created_at":"2026-08-11T10:10:07.048Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-c38b30cd4a684b40","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5e1f26e59bc030f3e7f64deb7cc20dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:07.057Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-acaf62e446191a91d5a0076e: start","job_status":"start","queue_duration_s":1.056847,"scheduling_latency_s":1.056869} gitlab # [ 176.235267] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:08.124Z","message":"No existing merge request to be cleaned up."} gitlab # [ 176.237093] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:08.131Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"acaf62e446191a91d5a0076e","created_at":"2026-08-11T10:10:07.048Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-c38b30cd4a684b40","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5e1f26e59bc030f3e7f64deb7cc20dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:07.057Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-acaf62e446191a91d5a0076e: done: 0.017478 sec","job_status":"done","queue_duration_s":1.056847,"scheduling_latency_s":1.056869,"redis_calls":10,"redis_duration_s":0.002677,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000875,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001802,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017478,"completed_at":"2026-08-11T10:10:08.131Z","load_balancing_strategy":"primary","db_duration_s":0.001384,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 176.345056] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:08.132Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"392ccbe5b6f03b2e829b06ee","created_at":"2026-08-11T10:10:07.048Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-c38b30cd4a684b40","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5e1f26e59bc030f3e7f64deb7cc20dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:07.057Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-392ccbe5b6f03b2e829b06ee: start","job_status":"start","queue_duration_s":1.075643,"scheduling_latency_s":1.075663} gitlab # [ 176.346268] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:08.142Z","message":"No existing merge request to be cleaned up."} gitlab # [ 176.347231] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:08.149Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"392ccbe5b6f03b2e829b06ee","created_at":"2026-08-11T10:10:07.048Z","trace_propagation_headers":{"sentry-trace":"c264e148b24248c7a7b14ef9fec7049c-c38b30cd4a684b40","baggage":"sentry-trace_id=c264e148b24248c7a7b14ef9fec7049c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5e1f26e59bc030f3e7f64deb7cc20dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:07.057Z","job_size_bytes":2,"pid":1701,"sidekiq_tid":"mak1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-392ccbe5b6f03b2e829b06ee: done: 0.01615 sec","job_status":"done","queue_duration_s":1.075643,"scheduling_latency_s":1.075663,"redis_calls":10,"redis_duration_s":0.002247,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001326,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01615,"completed_at":"2026-08-11T10:10:08.148Z","load_balancing_strategy":"primary","db_duration_s":0.001448,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 176.708218] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 4184021704 wd_nsec: 4184020469 gitlab # [ 196.152930] postgres[2511]: [2511] ERROR: relation "table_without_models" does not exist gitlab # [ 196.154516] postgres[2511]: [2511] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 199.248634] runuser[2297]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 199.250760] setup-gitlab-start[2272]: + systemctl restart gitlab-sidekiq.service gitlab # [ 199.276162] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 199.277588] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:34.893Z","message":"Shutting down"} gitlab # [ 199.280045] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:34.894Z","message":"Scheduler exiting..."} gitlab # [ 199.282956] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:34.894Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 199.285835] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:34.895Z","message":"Scheduler exiting..."} gitlab # [ 199.780136] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:35.396Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 203.285880] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:38.901Z","message":"Bye!"} gitlab # [ 203.323292] sidekiq-cluster[1701]: {"severity":"INFO","time":"2026-08-11T10:10:38.940Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1701,"worker_id":"sidekiq_0","memwd_rss_bytes":940978176,"retry":0} gitlab # [ 204.509823] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 204.515184] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 204.518394] systemd[1]: gitlab-sidekiq.service: Consumed 1min 2.203s CPU time over 2min 1.515s wall clock time, 956.4M memory peak, 4.4M read from disk. gitlab # [ 204.533849] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 204.539232] setup-gitlab-start[2272]: + mkdir -p /var/lib/secrets gitlab # [ 204.543962] setup-gitlab-start[2272]: + echo nixbot-test-token-of-20-chars gitlab # [ 204.546131] setup-gitlab-start[2272]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 204.549242] setup-gitlab-start[2272]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 205.581983] gitaly[932]: time="2026-08-11T10:10:41.198Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:10:51.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.197" pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.599241] gitaly[932]: time="2026-08-11T10:10:41.199Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:10:51.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.197" grpc.time_ms=0.762 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.782314] gitaly[932]: time="2026-08-11T10:10:41.399Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:10:51.208" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.399" pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.821619] gitaly[932]: time="2026-08-11T10:10:41.399Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:10:51.208" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.399" grpc.time_ms=0.291 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.852817] gitaly[932]: time="2026-08-11T10:10:41.469Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC diskcache=5c067b34-cad8-46f9-9ccd-af29833784e5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T10:10:51.221" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.411" pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.870500] gitaly[932]: time="2026-08-11T10:10:41.487Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1571 command.oublock=32 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T10:10:51.221" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.411" grpc.time_ms=58.474 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.871126] gitaly[932]: time="2026-08-11T10:10:41.488Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:10:51.296" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.487" pid=932 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 205.872833] gitaly[932]: time="2026-08-11T10:10:41.488Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:10:51.296" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.487" grpc.time_ms=0.901 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.882293] gitaly[932]: time="2026-08-11T10:10:41.499Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:10:51.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.493" grpc.time_ms=5.659 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.936390] gitaly[932]: time="2026-08-11T10:10:41.553Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:10:51.063" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.553" pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.938093] gitaly[932]: time="2026-08-11T10:10:41.553Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:10:51.063" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.553" grpc.time_ms=0.25 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.976059] gitaly[932]: time="2026-08-11T10:10:41.592Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC diskcache=95ee9082-c453-4518-983a-da0ddffcecc4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T10:10:51.066" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.557" pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.977307] gitaly[932]: time="2026-08-11T10:10:41.593Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1573 command.oublock=32 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T10:10:51.066" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.557" grpc.time_ms=36.022 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.984234] gitaly[932]: time="2026-08-11T10:10:41.601Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:10:51.110" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.601" pid=932 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 205.985830] gitaly[932]: time="2026-08-11T10:10:41.601Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:10:51.110" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.601" grpc.time_ms=0.492 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.996313] gitaly[932]: time="2026-08-11T10:10:41.613Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:10:51.117" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.607" grpc.time_ms=5.486 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 206.019775] gitaly[932]: time="2026-08-11T10:10:41.637Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:10:51.146" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.636" grpc.time_ms=0.142 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 206.097119] gitaly[932]: time="2026-08-11T10:10:41.646Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T10:10:51.155" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:41.646" grpc.time_ms=0.178 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 206.477690] gitaly[932]: time="2026-08-11T10:10:42.094Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V1DVGGCAETMM65Z3JXAC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:10:52.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:42.081" grpc.time_ms=13.221 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 206.904209] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:42 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 2329 gitlab # [ 206.904786] setup-gitlab-start[2272]: + mkdir -p /tmp/test-flake gitlab # [ 206.918487] setup-gitlab-start[2272]: + cd /tmp/test-flake gitlab # [ 206.918726] setup-gitlab-start[2272]: + git init -b master gitlab # [ 206.946732] setup-gitlab-start[2604]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 206.948103] setup-gitlab-start[2272]: + git config user.name test gitlab # [ 206.953861] setup-gitlab-start[2272]: + git config user.email test@example.com gitlab # [ 206.956953] setup-gitlab-start[2272]: + cat gitlab # [ 206.960479] setup-gitlab-start[2272]: + git add flake.nix gitlab # [ 206.965885] setup-gitlab-start[2272]: + git commit -m 'initial commit' gitlab # [ 206.989556] setup-gitlab-start[2612]: [master (root-commit) 2bc5413] initial commit gitlab # [ 206.989770] setup-gitlab-start[2612]: 1 file changed, 10 insertions(+) gitlab # [ 206.992467] setup-gitlab-start[2612]: create mode 100644 flake.nix gitlab # [ 206.994814] setup-gitlab-start[2272]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 207.007686] setup-gitlab-start[2272]: + git push -u origin master gitlab # [ 207.069894] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:42 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 36 gitlab # [ 207.177219] gitaly[932]: time="2026-08-11T10:10:42.794Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V3W1EF1N44ZT7NHHKXS5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:42.779" grpc.time_ms=14.688 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 207.178380] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:42 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 105 gitlab # [ 207.737447] gitaly[932]: time="2026-08-11T10:10:43.354Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:10:53.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:43.340" grpc.time_ms=14.214 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.832403] gitaly[932]: time="2026-08-11T10:10:43.449Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=332 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-11T10:11:13.033" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-11T10:10:43.434" grpc.time_ms=14.977 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.923835] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-11T10:10:43.522Z","message":"Starting cluster with 1 processes"} gitlab # [ 207.938881] gitaly[932]: time="2026-08-11T10:10:43.556Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZR4V414QXZP0NV7APADZ6CA duration_ms=527ns method=POST pid=932 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 207.972210] gitaly[932]: time="2026-08-11T10:10:43.589Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZR4V414QXZP0NV7APADZ6CA duration_ms=32ns method=POST pid=932 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 207.973415] gitaly[932]: time="2026-08-11T10:10:43.590Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5309 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:10:43.028" grpc.time_ms=562.339 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 208.050911] gitaly[932]: time="2026-08-11T10:10:43.668Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:10:43.667" grpc.time_ms=0.563 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 208.107095] gitaly[932]: time="2026-08-11T10:10:43.724Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:10:43.723" grpc.time_ms=0.458 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 208.152204] gitaly[932]: time="2026-08-11T10:10:43.769Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:10:43.768" grpc.time_ms=0.974 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 208.256970] gitaly[932]: time="2026-08-11T10:10:43.873Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:10:53.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:43.864" grpc.time_ms=8.702 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 208.317052] gitaly[932]: time="2026-08-11T10:10:43.934Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1570 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-11T10:10:53.043" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:10:43.905" grpc.time_ms=28.1 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 208.356121] gitaly[932]: time="2026-08-11T10:10:43.973Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZR4V414QXZP0NV7APADZ6CA duration_ms=161ns method=POST pid=932 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 208.357376] gitaly[932]: time="2026-08-11T10:10:43.974Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4803 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:10:43.810" grpc.time_ms=163.606 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 208.386974] gitaly[932]: time="2026-08-11T10:10:44.004Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA diskcache=8f15aaf7-cd49-4c56-9bb9-b47293de19a8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:42.938" pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 208.402958] gitaly[932]: time="2026-08-11T10:10:44.004Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=280 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=14075 command.oublock=32 command.real_time_ms=1056 command.spawn_token_fork_ms=1 command.system_time_ms=183 command.user_time_ms=97 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:42.938" grpc.time_ms=1066.217 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 208.424699] gitlab-workhorse[831]: time="2026-08-11T10:10:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 208.425738] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:44 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 1152 gitlab # [ 208.427569] setup-gitlab-start[2618]: To http://gitlab/root/test-flake.git gitlab # [ 208.428345] setup-gitlab-start[2618]: * [new branch] master -> master gitlab # [ 208.435984] setup-gitlab-start[2618]: branch 'master' set up to track 'origin/master'. gitlab # [ 208.440741] systemd[1]: Finished setup-gitlab.service. gitlab # [ 208.443990] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 210.14 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 209.564467] nixbot[2713]: {"ts": "2026-08-11T10:10:45.180Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 209.590105] nixbot[2713]: {"ts": "2026-08-11T10:10:45.207Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 209.632721] nixbot[2713]: {"ts": "2026-08-11T10:10:45.249Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 209.648271] nixbot[2713]: {"ts": "2026-08-11T10:10:45.265Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 209.657623] nixbot[2713]: {"ts": "2026-08-11T10:10:45.271Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 209.665820] nixbot[2713]: {"ts": "2026-08-11T10:10:45.282Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 209.674774] nixbot[2713]: {"ts": "2026-08-11T10:10:45.288Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 209.682913] nixbot[2713]: {"ts": "2026-08-11T10:10:45.299Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 209.700818] nixbot[2713]: {"ts": "2026-08-11T10:10:45.317Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 209.711609] nixbot[2713]: {"ts": "2026-08-11T10:10:45.328Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 209.727784] nixbot[2713]: {"ts": "2026-08-11T10:10:45.344Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 209.746854] nixbot[2713]: {"ts": "2026-08-11T10:10:45.363Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 209.753454] nixbot[2713]: {"ts": "2026-08-11T10:10:45.370Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 209.758267] nixbot[2713]: {"ts": "2026-08-11T10:10:45.375Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 209.765793] nixbot[2713]: {"ts": "2026-08-11T10:10:45.382Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 209.770405] nixbot[2713]: {"ts": "2026-08-11T10:10:45.387Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 209.774823] nixbot[2713]: {"ts": "2026-08-11T10:10:45.391Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 209.779442] nixbot[2713]: {"ts": "2026-08-11T10:10:45.395Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 209.787272] nixbot[2713]: {"ts": "2026-08-11T10:10:45.404Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 209.791599] nixbot[2713]: {"ts": "2026-08-11T10:10:45.408Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 209.796244] nixbot[2713]: {"ts": "2026-08-11T10:10:45.413Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 209.807575] nixbot[2713]: {"ts": "2026-08-11T10:10:45.424Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 209.814374] nixbot[2713]: {"ts": "2026-08-11T10:10:45.431Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 209.820718] nixbot[2713]: {"ts": "2026-08-11T10:10:45.437Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 209.827665] nixbot[2713]: {"ts": "2026-08-11T10:10:45.444Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 210.146688] nixbot[2713]: INFO: Started server process [2713] gitlab # [ 210.147091] nixbot[2713]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 210.165110] nixbot[2713]: INFO: ::ffff:127.0.0.1:43910 - "GET /health HTTP/1.1" 200 OK gitlab # [ 210.174908] systemd[1]: Started nixbot CI service. gitlab # [ 210.175892] systemd[1]: Reached target Multi-User System. gitlab # [ 210.180377] systemd[1]: Startup finished in 1.459s (kernel) + 3.765s (initrd) + 3min 24.955s (userspace) = 3min 30.180s. gitlab: (finished: waiting for unit nixbot.service, in 1.07 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 210.396102] nixbot[2713]: INFO: ::ffff:127.0.0.1:43922 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 210.421150] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:46 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 256 gitlab # [ 210.422953] nixbot[2713]: {"ts": "2026-08-11T10:10:46.040Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 210.443567] nixbot[2713]: {"ts": "2026-08-11T10:10:46.060Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 210.493678] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 67 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.10 seconds) gitlab # [ 210.575915] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 119 gitlab # [ 210.586560] nixbot[2713]: {"ts": "2026-08-11T10:10:46.194Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 210.596671] nixbot[2713]: {"ts": "2026-08-11T10:10:46.202Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 210.686762] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 97 gitlab # [ 210.696355] nixbot[2713]: {"ts": "2026-08-11T10:10:46.305Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab # [ 211.379473] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:46 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 678 gitlab # [ 211.381661] nixbot[2713]: {"ts": "2026-08-11T10:10:46.998Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 211.461638] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 63 gitlab # [ 211.463169] nixbot[2713]: {"ts": "2026-08-11T10:10:47.079Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 211.547986] nixbot[2713]: {"ts": "2026-08-11T10:10:47.165Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 211.551107] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:47 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 68 gitlab # [ 211.606841] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 86 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.12 seconds) (finished: subtest: project discovered and webhook registered, in 1.22 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 211.632425] gitaly[932]: time="2026-08-11T10:10:47.249Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V88GP0TX471WARX33RMN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-11T10:11:17.022" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:10:47.234" grpc.time_ms=14.037 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 211.686588] gitaly[932]: time="2026-08-11T10:10:47.303Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V88GP0TX471WARX33RMN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:11:17.102" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:10:47.302" grpc.time_ms=0.811 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 211.719127] gitaly[932]: time="2026-08-11T10:10:47.336Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V88GP0TX471WARX33RMN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-11T10:10:57.138" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:10:47.328" grpc.time_ms=7.336 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 211.728913] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:47 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 34 gitlab # [ 211.772327] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 205 gitlab # [ 211.774356] nixbot[2713]: {"ts": "2026-08-11T10:10:47.390Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 211.849165] gitaly[932]: time="2026-08-11T10:10:47.466Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8DM79Q8Y80KT4CTWYBQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:47.453" grpc.time_ms=12.109 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 211.850129] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:47 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 119 gitlab # Enumerating objects: 5, done. gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 137.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 211.950655] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 169 gitlab # [ 211.956122] nixbot[2713]: {"ts": "2026-08-11T10:10:47.573Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 211.965427] nixbot[2713]: {"ts": "2026-08-11T10:10:47.582Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 212.057377] gitaly[932]: time="2026-08-11T10:10:47.674Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8P3VX4JZVV9JXAXCB8B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:47.665" grpc.time_ms=9.392 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.080256] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:47 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 77 gitlab # [ 212.105137] gitaly[932]: time="2026-08-11T10:10:47.722Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-11T10:11:17.314" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-11T10:10:47.715" grpc.time_ms=6.893 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 212.116051] gitaly[932]: time="2026-08-11T10:10:47.733Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D duration_ms=73ns method=POST pid=932 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 212.136505] gitaly[932]: time="2026-08-11T10:10:47.753Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D duration_ms=20ns method=POST pid=932 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 212.141930] gitaly[932]: time="2026-08-11T10:10:47.759Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5309 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:10:47.659" grpc.time_ms=99.591 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 212.182749] gitaly[932]: time="2026-08-11T10:10:47.800Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V8RPWEKWP9KZSPYAPY7R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:47.789" pid=932 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 212.183887] gitaly[932]: time="2026-08-11T10:10:47.800Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V8RPWEKWP9KZSPYAPY7R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:47.789" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.186155] gitaly[932]: time="2026-08-11T10:10:47.800Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V8RPWEKWP9KZSPYAPY7R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:47.789" grpc.time_ms=11.586 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.189590] gitlab-workhorse[831]: time="2026-08-11T10:10:47Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 212.190889] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:47 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 98 gitlab # [ 212.198242] gitaly[932]: time="2026-08-11T10:10:47.815Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:10:47.814" grpc.time_ms=0.39 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 212.275256] gitaly[932]: time="2026-08-11T10:10:47.892Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V8W273QENXTCYARKFBZG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:47.870" pid=932 remote_ip="2001:db8:1::1" request_sha=e81c4c58d9080ab4f270244af4613461ef754e0b response_bytes=223 span.kind=server system=grpc gitlab # [ 212.276243] gitaly[932]: time="2026-08-11T10:10:47.892Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V8W273QENXTCYARKFBZG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:47.870" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.315790] gitaly[932]: time="2026-08-11T10:10:47.933Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V8W273QENXTCYARKFBZG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:47.870" grpc.time_ms=22.184 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.317325] gitlab-workhorse[831]: time="2026-08-11T10:10:47Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=223 gitlab # [ 212.319215] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:47 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 122 gitlab # [ 212.371253] gitaly[932]: time="2026-08-11T10:10:47.988Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:10:47.987" grpc.time_ms=0.498 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 212.413624] gitaly[932]: time="2026-08-11T10:10:48.030Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:10:48.029" grpc.time_ms=1.306 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 212.458530] gitaly[932]: time="2026-08-11T10:10:48.075Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9269YBVJVTR4ZAPA3NE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:48.065" grpc.time_ms=10.177 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.481748] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:48 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 69 gitlab # [ 212.503970] gitaly[932]: time="2026-08-11T10:10:48.121Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D duration_ms=44ns method=POST pid=932 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 212.509350] gitaly[932]: time="2026-08-11T10:10:48.123Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4803 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:10:48.076" grpc.time_ms=46.033 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # To http://gitlab/root/test-flake.git gitlab # 2bc5413..4668ea4 master -> master gitlab # [ 212.529977] gitaly[932]: time="2026-08-11T10:10:48.141Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D diskcache=905a6859-0852-4ea1-a3bb-912b150447c2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:47.603" pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 212.547326] gitlab-workhorse[831]: time="2026-08-11T10:10:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 212.551045] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:48 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 608 gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.94 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 212.554201] gitaly[932]: time="2026-08-11T10:10:48.143Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=240 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13357 command.oublock=32 command.real_time_ms=524 command.spawn_token_fork_ms=1 command.system_time_ms=185 command.user_time_ms=55 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:47.603" grpc.time_ms=537.257 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 212.577092] gitaly[932]: time="2026-08-11T10:10:48.178Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V94ENRZSF4DQGMXVNM9Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:48.158" pid=932 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 212.594535] gitlab-workhorse[831]: time="2026-08-11T10:10:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 212.598100] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 102 gitlab # [ 212.601628] gitaly[932]: time="2026-08-11T10:10:48.178Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V94ENRZSF4DQGMXVNM9Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:48.158" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.629224] gitaly[932]: time="2026-08-11T10:10:48.184Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V94ENRZSF4DQGMXVNM9Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:48.158" grpc.time_ms=20.716 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.649457] gitaly[932]: time="2026-08-11T10:10:48.265Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V97Q2HZ0AE5E5S3CWN08 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:48.241" pid=932 remote_ip="2001:db8:1::1" request_sha=9b75f729a4156ae50270f24d04ff0c0159abf000 response_bytes=338 span.kind=server system=grpc gitlab # [ 212.650478] gitaly[932]: time="2026-08-11T10:10:48.265Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1190 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V97Q2HZ0AE5E5S3CWN08 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:48.241" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.653836] gitaly[932]: time="2026-08-11T10:10:48.268Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1190 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V97Q2HZ0AE5E5S3CWN08 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:48.241" grpc.time_ms=26.708 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.655206] gitlab-workhorse[831]: time="2026-08-11T10:10:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=338 gitlab # [ 212.656089] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 338 "" "git/2.55.0" 86 gitlab # [ 212.730812] nixbot[2713]: INFO: ::ffff:127.0.0.1:43924 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.17 seconds) gitlab # [ 212.821377] gitaly[932]: time="2026-08-11T10:10:48.438Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9E16G4MD92PS92ZX4VX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:48.427" grpc.time_ms=10.72 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.854826] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:48 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 86 gitlab # [ 212.924258] gitaly[932]: time="2026-08-11T10:10:48.541Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9GT6K3B9VW0G9PE7QZ0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:48.526" pid=932 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 212.957382] gitaly[932]: time="2026-08-11T10:10:48.541Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9GT6K3B9VW0G9PE7QZ0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:48.526" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.981294] gitaly[932]: time="2026-08-11T10:10:48.598Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9GT6K3B9VW0G9PE7QZ0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:48.526" grpc.time_ms=71.974 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 212.982725] gitlab-workhorse[831]: time="2026-08-11T10:10:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 212.986462] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 124 gitlab # [ 213.115471] gitaly[932]: time="2026-08-11T10:10:48.732Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:11:18.330" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:10:48.731" grpc.time_ms=1.012 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 213.193276] gitaly[932]: time="2026-08-11T10:10:48.810Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-11T10:11:18.400" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:10:48.800" grpc.time_ms=9.816 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 213.262564] gitaly[932]: time="2026-08-11T10:10:48.879Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:10:58.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:10:48.866" grpc.time_ms=12.581 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 213.305700] gitaly[932]: time="2026-08-11T10:10:48.922Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:10:58.055" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:10:48.916" grpc.time_ms=6.857 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 213.383271] gitaly[932]: time="2026-08-11T10:10:49.000Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T10:10:58.139" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:48.999" grpc.time_ms=0.228 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 213.439647] gitaly[932]: time="2026-08-11T10:10:49.056Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T10:10:59.003" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:10:49.044" grpc.time_ms=11.708 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 213.488607] gitaly[932]: time="2026-08-11T10:10:49.105Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:10:49.104" grpc.time_ms=0.955 pid=932 span.kind=server system=grpc gitlab # [ 213.531103] gitaly[932]: time="2026-08-11T10:10:49.148Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:10:49.147" grpc.time_ms=0.305 pid=932 span.kind=server system=grpc gitlab # [ 213.556602] gitaly[932]: time="2026-08-11T10:10:49.173Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 diskcache=7c8e5a0d-5156-4614-9bb7-c235aa725a60 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:10:59.019" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:49.059" pid=932 ref=refs/keep-around/2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba remote_ip="2001:db8:1::1" revision=2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba span.kind=server system=grpc username=root gitlab # [ 213.557209] gitaly[932]: time="2026-08-11T10:10:49.174Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=116 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5352 command.oublock=8 command.real_time_ms=104 command.spawn_token_fork_ms=2 command.system_time_ms=77 command.user_time_ms=39 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:10:59.019" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:10:49.059" grpc.time_ms=114.041 pid=932 ref=refs/keep-around/2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba remote_ip="2001:db8:1::1" revision=2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba span.kind=server system=grpc username=root gitlab # [ 213.601163] gitaly[932]: time="2026-08-11T10:10:49.218Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:11:19.017" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:10:49.217" grpc.time_ms=0.482 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.03 seconds) gitlab # [ 213.773757] nixbot[2713]: INFO: ::ffff:127.0.0.1:58626 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab # [ 213.805871] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 743 gitlab # [ 213.816831] nixbot[2713]: {"ts": "2026-08-11T10:10:49.424Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba \"HTTP/1.1 201 Created\""} gitlab # [ 213.828597] nixbot[2713]: {"ts": "2026-08-11T10:10:49.434Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-2bc541350196-0"} gitlab # [ 213.870995] systemd[1]: Started Nix Daemon. gitlab # [ 213.925809] nix-daemon[2929]: accepted connection from pid 2923, user nixbot gitlab # [ 214.041578] nix-daemon[2929]: accepted connection from pid 2936, user nixbot gitlab # [ 214.067158] nixbot[2713]: {"ts": "2026-08-11T10:10:49.684Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-2bc541350196-0", "argv0": "bwrap"} gitlab # [ 214.241250] nix-daemon[2929]: accepted connection from pid 2946, user nixbot gitlab # [ 214.286125] nix-daemon[2929]: accepted connection from pid 2956, user nixbot gitlab # [ 214.314163] nix-daemon[2929]: accepted connection from pid 2946, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 214.820986] nixbot[2713]: INFO: ::ffff:127.0.0.1:58632 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 215.871965] nixbot[2713]: INFO: ::ffff:127.0.0.1:58644 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 216.922719] nixbot[2713]: INFO: ::ffff:127.0.0.1:58658 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 217.972429] nixbot[2713]: INFO: ::ffff:127.0.0.1:58666 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab # [ 218.568485] nix-daemon[2929]: accepted connection from pid 2984, user nixbot gitlab # [ 218.622100] gitaly[932]: time="2026-08-11T10:10:54.238Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4VF2N0DHAJYFH0S109AF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:11:24.036" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:10:54.237" grpc.time_ms=1.099 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 218.757602] gitaly[932]: time="2026-08-11T10:10:54.374Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4VF2N0DHAJYFH0S109AF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:11:04.169" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:10:54.360" grpc.time_ms=14.376 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 218.857250] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 306 gitlab # [ 218.867801] nixbot[2713]: {"ts": "2026-08-11T10:10:54.475Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba \"HTTP/1.1 201 Created\""} gitlab # [ 218.924758] gitaly[932]: time="2026-08-11T10:10:54.541Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4VFCJXD0ZRAVEHZY09FGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:11:24.139" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:10:54.540" grpc.time_ms=1.164 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 218.977800] gitaly[932]: time="2026-08-11T10:10:54.595Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4VFCJXD0ZRAVEHZY09FGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:11:04.257" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:10:54.588" grpc.time_ms=6.742 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 219.038136] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 172 gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.06 seconds) gitlab # [ 219.043058] nixbot[2713]: {"ts": "2026-08-11T10:10:54.657Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba \"HTTP/1.1 201 Created\""} gitlab # [ 219.047919] nixbot[2713]: INFO: ::ffff:127.0.0.1:58680 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 220.085513] nixbot[2713]: INFO: ::ffff:127.0.0.1:58694 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 221.138542] nixbot[2713]: INFO: ::ffff:127.0.0.1:58710 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 222.188827] nixbot[2713]: INFO: ::ffff:127.0.0.1:58716 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 223.238757] nixbot[2713]: INFO: ::ffff:127.0.0.1:43660 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab # [ 223.607737] nix-daemon[2929]: accepted connection from pid 3028, user nixbot gitlab # [ 223.719241] gitaly[932]: time="2026-08-11T10:10:59.335Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4VM28YQ5C0EBG7GHBPH8S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:11:29.132" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:10:59.333" grpc.time_ms=1.117 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 223.829651] gitaly[932]: time="2026-08-11T10:10:59.446Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4VM28YQ5C0EBG7GHBPH8S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:11:09.100" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:10:59.431" grpc.time_ms=14.673 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 223.893986] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:59 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 236 gitlab # [ 223.902781] nixbot[2713]: {"ts": "2026-08-11T10:10:59.511Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba \"HTTP/1.1 201 Created\""} gitlab # [ 223.975700] nix-daemon[2929]: accepted connection from pid 3042, user nixbot gitlab # [ 224.115497] gitaly[932]: time="2026-08-11T10:10:59.732Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4VMEB6KVSQHXN1HKWA8Y7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:59.718" grpc.time_ms=14.174 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 224.136291] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:59 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 74 gitlab # [ 224.190092] gitaly[932]: time="2026-08-11T10:10:59.806Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4VMGTBT7AR43ECRFZ2PD0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:59.796" pid=932 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 224.206145] gitaly[932]: time="2026-08-11T10:10:59.806Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4VMGTBT7AR43ECRFZ2PD0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:59.796" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 224.226875] gitaly[932]: time="2026-08-11T10:10:59.807Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4VMGTBT7AR43ECRFZ2PD0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:10:59.796" grpc.time_ms=10.135 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 224.250363] gitlab-workhorse[831]: time="2026-08-11T10:10:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 224.253552] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:10:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 128 gitlab # [ 224.284719] nixbot[2713]: INFO: ::ffff:127.0.0.1:43670 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.04 seconds) gitlab # [ 224.358558] nix-daemon[2929]: accepted connection from pid 3070, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 225.330958] nixbot[2713]: INFO: ::ffff:127.0.0.1:43674 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 226.380152] nixbot[2713]: INFO: ::ffff:127.0.0.1:43678 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 227.433796] nixbot[2713]: INFO: ::ffff:127.0.0.1:43684 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 228.487776] nixbot[2713]: INFO: ::ffff:127.0.0.1:43686 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 229.538744] nixbot[2713]: INFO: ::ffff:127.0.0.1:43700 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 230.591804] nixbot[2713]: INFO: ::ffff:127.0.0.1:43714 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 231.645803] nixbot[2713]: INFO: ::ffff:127.0.0.1:43724 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 232.698830] nixbot[2713]: INFO: ::ffff:127.0.0.1:43730 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 233.747744] nixbot[2713]: INFO: ::ffff:127.0.0.1:58448 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 234.783448] nixbot[2713]: INFO: ::ffff:127.0.0.1:58462 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 235.830802] nixbot[2713]: INFO: ::ffff:127.0.0.1:58470 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab # [ 235.935470] sidekiq-cluster[2662]: 2026-08-11T10:11:11.551Z pid=2662 tid=xce INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2662, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433741824} gitlab # [ 236.136975] sidekiq-cluster[2662]: W, [2026-08-11T10:11:11.753704 #2662] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 236.182288] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:11.799Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 236.879894] nixbot[2713]: INFO: ::ffff:127.0.0.1:58478 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 237.924401] nixbot[2713]: INFO: ::ffff:127.0.0.1:58492 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.04 seconds) gitlab # [ 238.233626] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:13.849Z","message":"GitLab reliable fetch activated!"} gitlab # [ 238.235010] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:13.849Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 238.969508] nixbot[2713]: INFO: ::ffff:127.0.0.1:58500 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 240.013763] nixbot[2713]: INFO: ::ffff:127.0.0.1:58506 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 241.057758] nixbot[2713]: INFO: ::ffff:127.0.0.1:58516 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 242.104286] nixbot[2713]: INFO: ::ffff:127.0.0.1:58528 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 243.153942] nixbot[2713]: INFO: ::ffff:127.0.0.1:46644 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 244.205874] nixbot[2713]: INFO: ::ffff:127.0.0.1:46648 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 245.259871] nixbot[2713]: INFO: ::ffff:127.0.0.1:46660 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 246.312833] nixbot[2713]: INFO: ::ffff:127.0.0.1:46674 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 247.366427] nixbot[2713]: INFO: ::ffff:127.0.0.1:46678 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 248.416995] nixbot[2713]: INFO: ::ffff:127.0.0.1:46686 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.04 seconds) gitlab # [ 249.467957] nixbot[2713]: INFO: ::ffff:127.0.0.1:46694 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 250.512221] nixbot[2713]: INFO: ::ffff:127.0.0.1:46708 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 251.563300] nixbot[2713]: INFO: ::ffff:127.0.0.1:46714 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 252.614753] nixbot[2713]: INFO: ::ffff:127.0.0.1:46726 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.04 seconds) gitlab # [ 253.666114] nixbot[2713]: INFO: ::ffff:127.0.0.1:45986 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 254.710627] nixbot[2713]: INFO: ::ffff:127.0.0.1:45992 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 255.762172] nixbot[2713]: INFO: ::ffff:127.0.0.1:45996 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 256.812978] nixbot[2713]: INFO: ::ffff:127.0.0.1:46006 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 257.862545] nixbot[2713]: INFO: ::ffff:127.0.0.1:46018 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 258.914516] nixbot[2713]: INFO: ::ffff:127.0.0.1:46020 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 259.965308] nixbot[2713]: INFO: ::ffff:127.0.0.1:46026 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 261.015569] nixbot[2713]: INFO: ::ffff:127.0.0.1:46030 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab # [ 261.053469] postgres[3196]: [3196] ERROR: relation "table_without_models" does not exist gitlab # [ 261.058459] postgres[3196]: [3196] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 262.066341] nixbot[2713]: INFO: ::ffff:127.0.0.1:46040 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 263.119944] nixbot[2713]: INFO: ::ffff:127.0.0.1:40358 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab # [ 263.725167] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:39.341Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 263.726912] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:39.343Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 263.729813] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:39.343Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 263.732706] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:39.343Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 263.758283] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:39.375Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 264.171402] nixbot[2713]: INFO: ::ffff:127.0.0.1:40366 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 265.224892] nixbot[2713]: INFO: ::ffff:127.0.0.1:40378 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab # [ 265.308371] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:40.924Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"aaf60366d6fca179707220c9","created_at":"2026-08-11T10:10:41.508Z","trace_propagation_headers":{"sentry-trace":"8f503589949e4309bbbfc710b8538fb8-bb239eb7552041fe","baggage":"sentry-trace_id=8f503589949e4309bbbfc710b8538fb8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V1DVGGCAETMM65Z3JXAC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:41.535Z","job_size_bytes":2,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-aaf60366d6fca179707220c9: start","job_status":"start","queue_duration_s":59.389346,"scheduling_latency_s":59.389526} gitlab # [ 265.619395] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:41.235Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"aaf60366d6fca179707220c9","created_at":"2026-08-11T10:10:41.508Z","trace_propagation_headers":{"sentry-trace":"8f503589949e4309bbbfc710b8538fb8-bb239eb7552041fe","baggage":"sentry-trace_id=8f503589949e4309bbbfc710b8538fb8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V1DVGGCAETMM65Z3JXAC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:41.535Z","job_size_bytes":2,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-aaf60366d6fca179707220c9: done: 0.311894 sec","job_status":"done","queue_duration_s":59.389346,"scheduling_latency_s":59.389526,"redis_calls":24,"redis_duration_s":0.014438,"redis_read_bytes":1038,"redis_write_bytes":2604,"redis_feature_flag_calls":14,"redis_feature_flag_duration_s":0.008158,"redis_feature_flag_read_bytes":1030,"redis_feature_flag_write_bytes":1439,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003581,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002699,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.106835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.116711761,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.311894,"completed_at":"2026-08-11T10:11:41.235Z","load_balancing_strategy":"primary","db_duration_s":0.085006,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 265.726721] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:41.343Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"1327d8af02217853be0840c3","created_at":"2026-08-11T10:10:41.544Z","trace_propagation_headers":{"sentry-trace":"8f503589949e4309bbbfc710b8538fb8-bb239eb7552041fe","baggage":"sentry-trace_id=8f503589949e4309bbbfc710b8538fb8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V1DVGGCAETMM65Z3JXAC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:41.549Z","job_size_bytes":2,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-1327d8af02217853be0840c3: start","job_status":"start","queue_duration_s":59.793711,"scheduling_latency_s":59.793784} gitlab # [ 265.885769] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:41.502Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"1327d8af02217853be0840c3","created_at":"2026-08-11T10:10:41.544Z","trace_propagation_headers":{"sentry-trace":"8f503589949e4309bbbfc710b8538fb8-bb239eb7552041fe","baggage":"sentry-trace_id=8f503589949e4309bbbfc710b8538fb8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V1DVGGCAETMM65Z3JXAC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:41.549Z","job_size_bytes":2,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-1327d8af02217853be0840c3: done: 0.159481 sec","job_status":"done","queue_duration_s":59.793711,"scheduling_latency_s":59.793784,"redis_calls":14,"redis_duration_s":0.008071,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.002052,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003566,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002453,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.088276,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09419772500000001,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.159481,"completed_at":"2026-08-11T10:11:41.502Z","load_balancing_strategy":"primary","db_duration_s":0.033807,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 265.992612] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:41.609Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"a21a30671bd6ef52192e800d","created_at":"2026-08-11T10:10:41.988Z","trace_propagation_headers":{"sentry-trace":"8f503589949e4309bbbfc710b8538fb8-bb239eb7552041fe","baggage":"sentry-trace_id=8f503589949e4309bbbfc710b8538fb8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V1DVGGCAETMM65Z3JXAC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:41.995Z","job_size_bytes":5,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-a21a30671bd6ef52192e800d: start","job_status":"start","queue_duration_s":59.61401,"scheduling_latency_s":59.614053} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 266.199207] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:41.815Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"a21a30671bd6ef52192e800d","created_at":"2026-08-11T10:10:41.988Z","trace_propagation_headers":{"sentry-trace":"8f503589949e4309bbbfc710b8538fb8-bb239eb7552041fe","baggage":"sentry-trace_id=8f503589949e4309bbbfc710b8538fb8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V1DVGGCAETMM65Z3JXAC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:41.995Z","job_size_bytes":5,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-a21a30671bd6ef52192e800d: done: 0.206611 sec","job_status":"done","queue_duration_s":59.61401,"scheduling_latency_s":59.614053,"redis_calls":12,"redis_duration_s":0.005615,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001153,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003554,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.130957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000593651,"duration_s":0.206611,"completed_at":"2026-08-11T10:11:41.815Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035704,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 266.307553] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:41.924Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"864164a82118f21883bcbb74","created_at":"2026-08-11T10:10:42.022Z","trace_propagation_headers":{"sentry-trace":"8f503589949e4309bbbfc710b8538fb8-bb239eb7552041fe","baggage":"sentry-trace_id=8f503589949e4309bbbfc710b8538fb8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V1DVGGCAETMM65Z3JXAC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:42.027Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-864164a82118f21883bcbb74: start","job_status":"start","queue_duration_s":59.89641,"scheduling_latency_s":59.896482} gitlab # [ 266.325163] nixbot[2713]: INFO: ::ffff:127.0.0.1:40380 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.10 seconds) gitlab # [ 266.533666] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:42.149Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"864164a82118f21883bcbb74","created_at":"2026-08-11T10:10:42.022Z","trace_propagation_headers":{"sentry-trace":"8f503589949e4309bbbfc710b8538fb8-bb239eb7552041fe","baggage":"sentry-trace_id=8f503589949e4309bbbfc710b8538fb8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V1DVGGCAETMM65Z3JXAC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:42.027Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-864164a82118f21883bcbb74: done: 0.225386 sec","job_status":"done","queue_duration_s":59.89641,"scheduling_latency_s":59.896482,"redis_calls":11,"redis_duration_s":0.005045,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001139,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000711,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.168,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.168,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.119422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000530794,"duration_s":0.225386,"completed_at":"2026-08-11T10:11:42.149Z","load_balancing_strategy":"primary","db_duration_s":0.100405,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.537501] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:42.151Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"b6b2d60391ad028c0ba53055","created_at":"2026-08-11T10:10:42.030Z","trace_propagation_headers":{"sentry-trace":"8f503589949e4309bbbfc710b8538fb8-bb239eb7552041fe","baggage":"sentry-trace_id=8f503589949e4309bbbfc710b8538fb8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V1DVGGCAETMM65Z3JXAC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:42.034Z","job_size_bytes":89,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-b6b2d60391ad028c0ba53055: start","job_status":"start","queue_duration_s":60.116756,"scheduling_latency_s":60.116781} gitlab # [ 266.589509] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:42.188Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"b6b2d60391ad028c0ba53055","created_at":"2026-08-11T10:10:42.030Z","trace_propagation_headers":{"sentry-trace":"8f503589949e4309bbbfc710b8538fb8-bb239eb7552041fe","baggage":"sentry-trace_id=8f503589949e4309bbbfc710b8538fb8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V1DVGGCAETMM65Z3JXAC","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:42.034Z","job_size_bytes":89,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-b6b2d60391ad028c0ba53055: done: 0.037451 sec","job_status":"done","queue_duration_s":60.116756,"scheduling_latency_s":60.116781,"redis_calls":11,"redis_duration_s":0.004869,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001277,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002764,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000828,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000546997,"duration_s":0.037451,"completed_at":"2026-08-11T10:11:42.188Z","load_balancing_strategy":"primary","db_duration_s":0.007882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.660559] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:42.191Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"fb8c4c71be21edd71b0d4db1","created_at":"2026-08-11T10:10:43.847Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-bb7947be18844f95","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:43.851Z","job_size_bytes":185,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-fb8c4c71be21edd71b0d4db1: start","job_status":"start","queue_duration_s":58.339661,"scheduling_latency_s":58.339682} gitlab # [ 266.687280] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:42.208Z","message":"changes: \"0000000000000000000000000000000000000000 2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba refs/heads/master\\n\""} gitlab # [ 266.713566] gitaly[932]: time="2026-08-11T10:11:42.330Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=87 command.spawn_token_fork_ms=81 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:11:52.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:42.239" grpc.time_ms=90.182 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 266.727871] gitaly[932]: time="2026-08-11T10:11:42.345Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:11:52.107" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:11:42.338" grpc.time_ms=6.675 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 266.779996] gitaly[932]: time="2026-08-11T10:11:42.397Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-11T10:11:52.155" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:42.385" grpc.time_ms=11.197 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 266.827587] gitaly[932]: time="2026-08-11T10:11:42.444Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3931 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:11:42.444" grpc.time_ms=0.59 pid=932 span.kind=server system=grpc gitlab # [ 266.869077] gitaly[932]: time="2026-08-11T10:11:42.486Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:11:42.484" grpc.time_ms=1.158 pid=932 span.kind=server system=grpc gitlab # [ 266.894324] gitaly[932]: time="2026-08-11T10:11:42.511Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA diskcache=343e92d2-512e-4d03-aafd-ba330866838f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:11:52.184" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:11:42.414" pid=932 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 266.894881] gitaly[932]: time="2026-08-11T10:11:42.511Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=58 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4922 command.oublock=8 command.real_time_ms=89 command.spawn_token_fork_ms=0 command.system_time_ms=41 command.user_time_ms=17 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:11:52.184" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:11:42.414" grpc.time_ms=96.889 pid=932 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 266.959203] gitaly[932]: time="2026-08-11T10:11:42.576Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:11:52.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:11:42.575" grpc.time_ms=0.316 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.004316] gitaly[932]: time="2026-08-11T10:11:42.621Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=941 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-11T10:11:52.030" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:42.600" grpc.time_ms=20.272 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.094300] gitaly[932]: time="2026-08-11T10:11:42.711Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=337 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-11T10:12:12.003" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:42.704" grpc.time_ms=6.565 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.121150] gitaly[932]: time="2026-08-11T10:11:42.738Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T10:11:52.166" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:11:42.737" grpc.time_ms=0.448 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.131797] gitaly[932]: time="2026-08-11T10:11:42.749Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-11T10:11:52.172" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-11T10:11:42.743" grpc.time_ms=5.273 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.165051] gitaly[932]: time="2026-08-11T10:11:42.782Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:11:52.205" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:42.775" grpc.time_ms=6.442 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.184566] gitaly[932]: time="2026-08-11T10:11:42.801Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:11:52.221" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:42.791" grpc.time_ms=9.94 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.225733] gitaly[932]: time="2026-08-11T10:11:42.842Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T10:12:12.121" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:42.822" grpc.time_ms=20.481 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 267.388574] nixbot[2713]: INFO: ::ffff:127.0.0.1:40382 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.06 seconds) gitlab # [ 267.671324] gitaly[932]: time="2026-08-11T10:11:43.288Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-11T10:11:53.055" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:43.285" grpc.time_ms=2.072 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.729834] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:43.345Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"fb8c4c71be21edd71b0d4db1","created_at":"2026-08-11T10:10:43.847Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-bb7947be18844f95","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:43.851Z","job_size_bytes":185,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-fb8c4c71be21edd71b0d4db1: done: 1.154808 sec","job_status":"done","queue_duration_s":58.339661,"scheduling_latency_s":58.339682,"gitaly_calls":13,"gitaly_duration_s":0.4111,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.082578,"redis_read_bytes":2103,"redis_write_bytes":21748,"redis_cache_calls":15,"redis_cache_duration_s":0.007738,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.01216,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002862,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7836,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.008888,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.030611,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.020319,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.068,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.218,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.244,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.068,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.580509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000731377,"exclusive_lock_hold_duration_s":0.115206821,"duration_s":1.154808,"completed_at":"2026-08-11T10:11:43.345Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.118123,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 267.815533] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:43.348Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba 4668ea4a0c9a47b7af58d56ac92204f3314bf81b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2ebb2fa51b9fddc1b0664722","created_at":"2026-08-11T10:10:48.105Z","trace_propagation_headers":{"sentry-trace":"b505f32993044252996855c835116678-71efd6bb00e84f0b","baggage":"sentry-trace_id=b505f32993044252996855c835116678,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V8KDPAHFYXVF8HNKWG8D","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:48.106Z","job_size_bytes":185,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2ebb2fa51b9fddc1b0664722: start","job_status":"start","queue_duration_s":55.241369,"scheduling_latency_s":55.241391} gitlab # [ 267.816838] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:43.361Z","message":"changes: \"2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba 4668ea4a0c9a47b7af58d56ac92204f3314bf81b refs/heads/master\\n\""} gitlab # [ 267.817948] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:43.414Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"2fbe72ac5ffa2e783d8b76ee","created_at":"2026-08-11T10:11:43.410Z","trace_propagation_headers":{"sentry-trace":"b505f32993044252996855c835116678-4d3bb20675944795","baggage":"sentry-trace_id=b505f32993044252996855c835116678,sentry-release=Unknown"},"correlation_id":"01KZR4V8KDPAHFYXVF8HNKWG8D","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"94d3ac6465527897fdac0b48","job_size_bytes":46,"pid":2662,"job_status":"deduplicated","message":"ProjectCacheWorker JID-2fbe72ac5ffa2e783d8b76ee: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 267.819505] gitaly[932]: time="2026-08-11T10:11:43.393Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:11:53.149" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:43.380" grpc.time_ms=12.797 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.827983] gitaly[932]: time="2026-08-11T10:11:43.405Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:11:53.167" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:11:43.398" grpc.time_ms=7.449 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.924338] gitaly[932]: time="2026-08-11T10:11:43.541Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=108 command.spawn_token_fork_ms=102 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-11T10:11:53.201" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:43.431" grpc.time_ms=109.948 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.945543] gitaly[932]: time="2026-08-11T10:11:43.554Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-11T10:12:13.046" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:43.546" grpc.time_ms=7.145 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.969406] gitaly[932]: time="2026-08-11T10:11:43.586Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-11T10:11:53.002" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-11T10:11:43.562" grpc.time_ms=23.777 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 267.982888] gitaly[932]: time="2026-08-11T10:11:43.600Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:11:53.023" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:43.593" grpc.time_ms=6.196 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 268.052392] gitaly[932]: time="2026-08-11T10:11:43.669Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-11T10:11:53.097" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:43.667" grpc.time_ms=1.486 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 268.113415] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:43.729Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba 4668ea4a0c9a47b7af58d56ac92204f3314bf81b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2ebb2fa51b9fddc1b0664722","created_at":"2026-08-11T10:10:48.105Z","trace_propagation_headers":{"sentry-trace":"b505f32993044252996855c835116678-71efd6bb00e84f0b","baggage":"sentry-trace_id=b505f32993044252996855c835116678,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V8KDPAHFYXVF8HNKWG8D","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:10:48.106Z","job_size_bytes":185,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2ebb2fa51b9fddc1b0664722: done: 0.381312 sec","job_status":"done","queue_duration_s":55.241369,"scheduling_latency_s":55.241391,"gitaly_calls":7,"gitaly_duration_s":0.206749,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.028543,"redis_read_bytes":500,"redis_write_bytes":11938,"redis_cache_calls":9,"redis_cache_duration_s":0.002434,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001166,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5715,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00458,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.010437,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.009926,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.019,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.019,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.135252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000671035,"exclusive_lock_hold_duration_s":0.0239198,"duration_s":0.381312,"completed_at":"2026-08-11T10:11:43.729Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023569,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 268.192307] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:43.808Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"898eee3171f91d68a1b6acb8","created_at":"2026-08-11T10:10:49.250Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-f81b444255504d69","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:49.266Z","job_size_bytes":65,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-898eee3171f91d68a1b6acb8: start","job_status":"start","queue_duration_s":54.542005,"scheduling_latency_s":54.542084} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab # [ 268.373353] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:43.990Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"898eee3171f91d68a1b6acb8","created_at":"2026-08-11T10:10:49.250Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-f81b444255504d69","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:49.266Z","job_size_bytes":65,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-898eee3171f91d68a1b6acb8: done: 0.182097 sec","job_status":"done","queue_duration_s":54.542005,"scheduling_latency_s":54.542084,"redis_calls":16,"redis_duration_s":0.011467,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.007061,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003334,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001072,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.127309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000571301,"duration_s":0.182097,"completed_at":"2026-08-11T10:11:43.990Z","load_balancing_strategy":"primary","db_duration_s":0.029632,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 268.377608] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:43.992Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"36c22e25110647e95c56c583","created_at":"2026-08-11T10:10:49.269Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-f81b444255504d69","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:49.278Z","job_size_bytes":65,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-36c22e25110647e95c56c583: start","job_status":"start","queue_duration_s":54.714474,"scheduling_latency_s":54.714499} gitlab # [ 268.489136] nixbot[2713]: INFO: ::ffff:127.0.0.1:40394 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab # [ 268.538855] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:44.155Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"36c22e25110647e95c56c583","created_at":"2026-08-11T10:10:49.269Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-f81b444255504d69","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:49.278Z","job_size_bytes":65,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-36c22e25110647e95c56c583: done: 0.163185 sec","job_status":"done","queue_duration_s":54.714474,"scheduling_latency_s":54.714499,"redis_calls":21,"redis_duration_s":0.008321,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003158,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003354,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001809,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000915759,"duration_s":0.163185,"completed_at":"2026-08-11T10:11:44.155Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034814,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.541530] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:44.158Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"904cf06709edd5b43c7445d0","created_at":"2026-08-11T10:10:49.398Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-f81b444255504d69","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:49.405Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-904cf06709edd5b43c7445d0: start","job_status":"start","queue_duration_s":54.752742,"scheduling_latency_s":54.752765} gitlab # [ 268.711105] gitaly[932]: time="2026-08-11T10:11:44.328Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:11:44.327" grpc.time_ms=0.481 pid=932 span.kind=server system=grpc gitlab # [ 268.770384] gitaly[932]: time="2026-08-11T10:11:44.387Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:11:44.386" grpc.time_ms=0.818 pid=932 span.kind=server system=grpc gitlab # [ 268.818971] gitaly[932]: time="2026-08-11T10:11:44.436Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:11:44.435" grpc.time_ms=0.806 pid=932 span.kind=server system=grpc gitlab # [ 268.848244] gitaly[932]: time="2026-08-11T10:11:44.464Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 diskcache=c811af6a-a4ee-479c-b565-09d981676d8f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:12:14.090" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:44.291" pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 268.849564] gitaly[932]: time="2026-08-11T10:11:44.464Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=162 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7580 command.oublock=0 command.real_time_ms=164 command.spawn_token_fork_ms=1 command.system_time_ms=101 command.user_time_ms=61 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:12:14.090" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:44.291" grpc.time_ms=173.088 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 269.038377] gitaly[932]: time="2026-08-11T10:11:44.655Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:12:14.452" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:44.653" grpc.time_ms=1.826 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 269.134972] gitaly[932]: time="2026-08-11T10:11:44.751Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:14.548" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:44.749" grpc.time_ms=1.597 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 269.184878] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:44.765Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"904cf06709edd5b43c7445d0","created_at":"2026-08-11T10:10:49.398Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-f81b444255504d69","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:49.405Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2662,"job_status":"rescheduled","message":"PipelineProcessWorker JID-904cf06709edd5b43c7445d0: rescheduled"} gitlab # [ 269.186568] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:44.774Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"904cf06709edd5b43c7445d0","created_at":"2026-08-11T10:10:49.398Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-f81b444255504d69","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:10:49.405Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-904cf06709edd5b43c7445d0: done: 0.616343 sec","job_status":"done","queue_duration_s":54.752742,"scheduling_latency_s":54.752765,"gitaly_calls":3,"gitaly_duration_s":0.18719,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.052055,"redis_read_bytes":462,"redis_write_bytes":29296,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002178,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002409,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.018889,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.008195,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15583,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.01074,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001298,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001599,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004569,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.154,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.022,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.026,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.116,"db_ci_duration_s":0.038,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.223164,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.55567621,"duration_s":0.616343,"completed_at":"2026-08-11T10:11:44.774Z","load_balancing_strategy":"primary","db_duration_s":0.168398,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 269.229524] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:44.777Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"94d3ac6465527897fdac0b48","created_at":"2026-08-11T10:11:42.347Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-4f278a2a573d49f7","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:42.363Z","job_size_bytes":46,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-94d3ac6465527897fdac0b48: start","job_status":"start","queue_duration_s":2.413367,"scheduling_latency_s":2.413391} gitlab # [ 269.254557] gitaly[932]: time="2026-08-11T10:11:44.827Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-11T16:11:44.819" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:11:44.820" grpc.time_ms=6.992 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 269.271267] gitaly[932]: time="2026-08-11T10:11:44.848Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=655 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-11T10:12:14.634" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:44.835" grpc.time_ms=12.424 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 269.292301] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:44.874Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"94d3ac6465527897fdac0b48","created_at":"2026-08-11T10:11:42.347Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-4f278a2a573d49f7","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:42.363Z","job_size_bytes":46,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-94d3ac6465527897fdac0b48: done: 0.097339 sec","job_status":"done","queue_duration_s":2.413367,"scheduling_latency_s":2.413391,"gitaly_calls":2,"gitaly_duration_s":0.025837,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.011191,"redis_read_bytes":69,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002109,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.00079,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002532,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004618,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001142,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045703,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000469054,"duration_s":0.097339,"completed_at":"2026-08-11T10:11:44.874Z","load_balancing_strategy":"primary","db_duration_s":0.014983,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 269.405238] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:44.876Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e3809f095531f9233346007e","created_at":"2026-08-11T10:11:42.377Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-4f278a2a573d49f7","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:42.381Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e3809f095531f9233346007e: start","job_status":"start","queue_duration_s":2.494894,"scheduling_latency_s":2.494917} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.04 seconds) gitlab # [ 269.406546] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:45.011Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e3809f095531f9233346007e","created_at":"2026-08-11T10:11:42.377Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-4f278a2a573d49f7","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:42.381Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e3809f095531f9233346007e: done: 0.135147 sec","job_status":"done","queue_duration_s":2.494894,"scheduling_latency_s":2.494917,"gitaly_calls":1,"gitaly_duration_s":0.077218,"redis_calls":15,"redis_duration_s":0.005155,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000614,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002016,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00095,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001575,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.018,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.111661399,"duration_s":0.135147,"completed_at":"2026-08-11T10:11:45.011Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017683,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.467172] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:45.013Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"7ce7c7c438c682e066c3b05f","created_at":"2026-08-11T10:11:42.567Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-4f278a2a573d49f7","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:42.570Z","job_size_bytes":23,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-7ce7c7c438c682e066c3b05f: start","job_status":"start","queue_duration_s":2.443281,"scheduling_latency_s":2.44337} gitlab # [ 269.492154] gitaly[932]: time="2026-08-11T10:11:44.973Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA diskcache=884921bf-1b82-4456-9877-27f48d4b464d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T16:11:44.899" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:44.900" pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 269.508249] nixbot[2713]: INFO: ::ffff:127.0.0.1:40404 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab # [ 269.510853] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:45.065Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"7ce7c7c438c682e066c3b05f","created_at":"2026-08-11T10:11:42.567Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-4f278a2a573d49f7","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:42.570Z","job_size_bytes":23,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-7ce7c7c438c682e066c3b05f: done: 0.051976 sec","job_status":"done","queue_duration_s":2.443281,"scheduling_latency_s":2.44337,"gitaly_calls":1,"gitaly_duration_s":0.013334,"redis_calls":16,"redis_duration_s":0.005702,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000427,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001697,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002652,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051976,"completed_at":"2026-08-11T10:11:45.065Z","load_balancing_strategy":"primary","db_duration_s":0.003332,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 269.582173] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:45.067Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"194c2bf4b83fe7d9e9329712","created_at":"2026-08-11T10:11:43.148Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-4f278a2a573d49f7","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b410717fffb4f785c5bfd73a65acf0b3b23e769752e2f5020b4ae36886b25ee3","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:43.154Z","job_size_bytes":467,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-194c2bf4b83fe7d9e9329712: start","job_status":"start","queue_duration_s":1.912848,"scheduling_latency_s":1.912877} gitlab # [ 269.609911] gitaly[932]: time="2026-08-11T10:11:44.974Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1282 command.oublock=0 command.real_time_ms=122 command.spawn_token_fork_ms=51 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T16:11:44.899" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:44.900" grpc.time_ms=73.907 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 269.690105] gitaly[932]: time="2026-08-11T10:11:45.050Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=655 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-11T10:12:15.038" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:45.039" grpc.time_ms=10.544 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 269.691222] gitaly[932]: time="2026-08-11T10:11:45.095Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:15.093" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:45.094" grpc.time_ms=0.656 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 269.692091] gitaly[932]: time="2026-08-11T10:11:45.103Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T10:11:55.006" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:45.097" grpc.time_ms=6.758 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 269.692910] gitaly[932]: time="2026-08-11T10:11:45.185Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:12:15.184" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:45.184" grpc.time_ms=0.827 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 269.782340] gitaly[932]: time="2026-08-11T10:11:45.399Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=65 command.oublock=0 command.real_time_ms=209 command.spawn_token_fork_ms=208 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-11T10:12:15.188" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:45.189" grpc.time_ms=210.204 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 269.920993] gitaly[932]: time="2026-08-11T10:11:45.537Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:11:55.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:45.522" grpc.time_ms=14.974 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 270.441172] gitaly[932]: time="2026-08-11T10:11:46.058Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=959 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T10:12:16.034" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:46.034" grpc.time_ms=23.186 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 270.461677] gitaly[932]: time="2026-08-11T10:11:46.078Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=619 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V414QXZP0NV7APADZ6CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-11T10:12:16.060" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:46.060" grpc.time_ms=17.743 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 270.532080] nixbot[2713]: INFO: ::ffff:127.0.0.1:40418 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab # [ 270.559226] sidekiq-cluster[2662]: {"severity":"WARN","time":"2026-08-11T10:11:46.175Z","class":"CreatePipelineWorker","correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba","ref":"refs/heads/master"},"retry":0} gitlab # [ 270.565667] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:46.182Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"194c2bf4b83fe7d9e9329712","created_at":"2026-08-11T10:11:43.148Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-4f278a2a573d49f7","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b410717fffb4f785c5bfd73a65acf0b3b23e769752e2f5020b4ae36886b25ee3","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:43.154Z","job_size_bytes":467,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-194c2bf4b83fe7d9e9329712: done: 1.115587 sec","job_status":"done","queue_duration_s":1.912848,"scheduling_latency_s":1.912877,"gitaly_calls":7,"gitaly_duration_s":0.38032,"redis_calls":51,"redis_duration_s":0.017156,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.001652,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005727,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001885,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.006331,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001561,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.675848,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051487,"duration_s":1.115587,"completed_at":"2026-08-11T10:11:46.182Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.055208,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 270.578785] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:46.184Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"e30f15e5-3f61-46ef-8e63-f7f75c1202db\"}"],"class":"WebHookWorker","jid":"0e0c27e3e60bdd1a08c1ae00","created_at":"2026-08-11T10:11:43.255Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-4f278a2a573d49f7","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9fdb62f113c4b77f6694e900c4fb257566847851134bf771ebf9d8428498bf2f","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:43.261Z","job_size_bytes":1751,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-0e0c27e3e60bdd1a08c1ae00: start","job_status":"start","queue_duration_s":2.922883,"scheduling_latency_s":2.922906} gitlab # [ 270.682500] nixbot[2713]: INFO: ::ffff:127.0.0.1:40424 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 270.698541] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:46.315Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"e30f15e5-3f61-46ef-8e63-f7f75c1202db\"}"],"class":"WebHookWorker","jid":"0e0c27e3e60bdd1a08c1ae00","created_at":"2026-08-11T10:11:43.255Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-4f278a2a573d49f7","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9fdb62f113c4b77f6694e900c4fb257566847851134bf771ebf9d8428498bf2f","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:43.261Z","job_size_bytes":1751,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-0e0c27e3e60bdd1a08c1ae00: done: 0.1304 sec","job_status":"done","queue_duration_s":2.922883,"scheduling_latency_s":2.922906,"redis_calls":19,"redis_duration_s":0.005431,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001407,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000634,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.0022,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00119,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.033452295999950366,"cpu_s":0.079592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000364292,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.1304,"completed_at":"2026-08-11T10:11:46.315Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003958,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.776718] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:46.393Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b19a87d83a0a19db152fb7fe","created_at":"2026-08-11T10:11:43.421Z","trace_propagation_headers":{"sentry-trace":"b505f32993044252996855c835116678-4d3bb20675944795","baggage":"sentry-trace_id=b505f32993044252996855c835116678,sentry-release=Unknown"},"correlation_id":"01KZR4V8KDPAHFYXVF8HNKWG8D","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"e3809f095531f9233346007e","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:43.425Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b19a87d83a0a19db152fb7fe: start","job_status":"start","queue_duration_s":2.968126,"scheduling_latency_s":2.968197} gitlab # [ 270.831518] gitaly[932]: time="2026-08-11T10:11:46.448Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D diskcache=ee0d5ea8-9183-4405-bbde-cbbc12ad01bb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T16:11:46.434" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:46.435" pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 270.846979] gitaly[932]: time="2026-08-11T10:11:46.464Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=317 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T16:11:46.434" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:46.435" grpc.time_ms=13.605 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 270.870822] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:46.487Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b19a87d83a0a19db152fb7fe","created_at":"2026-08-11T10:11:43.421Z","trace_propagation_headers":{"sentry-trace":"b505f32993044252996855c835116678-4d3bb20675944795","baggage":"sentry-trace_id=b505f32993044252996855c835116678,sentry-release=Unknown"},"correlation_id":"01KZR4V8KDPAHFYXVF8HNKWG8D","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"e3809f095531f9233346007e","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:43.425Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b19a87d83a0a19db152fb7fe: done: 0.094749 sec","job_status":"done","queue_duration_s":2.968126,"scheduling_latency_s":2.968197,"gitaly_calls":1,"gitaly_duration_s":0.033052,"redis_calls":12,"redis_duration_s":0.004861,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001473,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00166,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.056271677,"duration_s":0.094749,"completed_at":"2026-08-11T10:11:46.487Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007168,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.943658] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:46.560Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"b573263a60b0dd5177632a0e","created_at":"2026-08-11T10:11:43.642Z","trace_propagation_headers":{"sentry-trace":"b505f32993044252996855c835116678-4d3bb20675944795","baggage":"sentry-trace_id=b505f32993044252996855c835116678,sentry-release=Unknown"},"correlation_id":"01KZR4V8KDPAHFYXVF8HNKWG8D","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdee16ce7e54a3b2523468a1146c4ec27d0387c0e7ee6a525c869e75a8d5f88d","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:43.644Z","job_size_bytes":467,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-b573263a60b0dd5177632a0e: start","job_status":"start","queue_duration_s":2.915382,"scheduling_latency_s":2.915454} gitlab # [ 270.996285] gitaly[932]: time="2026-08-11T10:11:46.612Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR4X20JJK098W1RWEEW9KEV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:11:46.601" grpc.time_ms=11.742 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 271.017338] gitaly[932]: time="2026-08-11T10:11:46.627Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:16.425" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:46.625" grpc.time_ms=0.679 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 271.019751] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:46 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 294 gitlab # [ 271.043561] gitaly[932]: time="2026-08-11T10:11:46.660Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=25 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T10:11:56.109" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:46.631" grpc.time_ms=28.981 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 271.077132] gitaly[932]: time="2026-08-11T10:11:46.694Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:12:16.493" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:46.693" grpc.time_ms=0.76 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 271.100363] gitaly[932]: time="2026-08-11T10:11:46.717Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=177 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-11T10:12:16.513" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:46.714" grpc.time_ms=2.781 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 271.111858] gitaly[932]: time="2026-08-11T10:11:46.729Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X29XS4CD37CVNSA4CK3A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:11:46.720" pid=932 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 271.113041] gitaly[932]: time="2026-08-11T10:11:46.729Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X29XS4CD37CVNSA4CK3A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:11:46.720" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 271.113820] gitaly[932]: time="2026-08-11T10:11:46.729Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X29XS4CD37CVNSA4CK3A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:11:46.720" grpc.time_ms=9.645 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 271.115043] gitlab-workhorse[831]: time="2026-08-11T10:11:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 271.180360] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:46 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 108 gitlab # [ 271.209399] nixbot[2713]: {"ts": "2026-08-11T10:11:46.826Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab # [ 271.224712] gitaly[932]: time="2026-08-11T10:11:46.841Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:11:56.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:46.835" grpc.time_ms=6.741 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 271.352758] gitaly[932]: time="2026-08-11T10:11:46.969Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X2GSVPJFDTHE7ASHNZTQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:16.567" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:46.968" grpc.time_ms=1.198 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 271.482290] gitaly[932]: time="2026-08-11T10:11:47.099Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4X2GSVPJFDTHE7ASHNZTQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:11:57.046" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:47.087" grpc.time_ms=12.03 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 271.537146] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:47 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 312 gitlab # [ 271.538068] nixbot[2713]: {"ts": "2026-08-11T10:11:47.154Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba \"HTTP/1.1 201 Created\""} gitlab # [ 271.562486] gitaly[932]: time="2026-08-11T10:11:47.179Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=961 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T10:12:17.167" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:47.168" grpc.time_ms=11.491 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 271.567206] nixbot[2713]: INFO: ::ffff:127.0.0.1:40428 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.05 seconds) gitlab # [ 271.597426] gitaly[932]: time="2026-08-11T10:11:47.214Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X2TP99AJ60FYR03D43FV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:17.013" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:47.213" grpc.time_ms=0.63 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 271.610396] gitaly[932]: time="2026-08-11T10:11:47.227Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V8KDPAHFYXVF8HNKWG8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-11T10:12:17.208" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:47.209" grpc.time_ms=18.347 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 271.623624] sidekiq-cluster[2662]: {"severity":"WARN","time":"2026-08-11T10:11:47.240Z","class":"CreatePipelineWorker","correlation_id":"01KZR4V8KDPAHFYXVF8HNKWG8D","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba","after":"4668ea4a0c9a47b7af58d56ac92204f3314bf81b","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"4668ea4a0c9a47b7af58d56ac92204f3314bf81b","ref":"refs/heads/master"},"retry":0} gitlab # [ 271.628459] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.245Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"b573263a60b0dd5177632a0e","created_at":"2026-08-11T10:11:43.642Z","trace_propagation_headers":{"sentry-trace":"b505f32993044252996855c835116678-4d3bb20675944795","baggage":"sentry-trace_id=b505f32993044252996855c835116678,sentry-release=Unknown"},"correlation_id":"01KZR4V8KDPAHFYXVF8HNKWG8D","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdee16ce7e54a3b2523468a1146c4ec27d0387c0e7ee6a525c869e75a8d5f88d","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:43.644Z","job_size_bytes":467,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-b573263a60b0dd5177632a0e: done: 0.685375 sec","job_status":"done","queue_duration_s":2.915382,"scheduling_latency_s":2.915454,"gitaly_calls":7,"gitaly_duration_s":0.235029,"redis_calls":33,"redis_duration_s":0.006575,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000654,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001514,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003231,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001176,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.39719,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.685375,"completed_at":"2026-08-11T10:11:47.245Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022003,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 271.653171] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.247Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"78d71ff9-a4cf-4bf5-b024-27dec8804725\"}"],"class":"WebHookWorker","jid":"6505c0b151eb0d0f88012e4f","created_at":"2026-08-11T10:11:43.656Z","trace_propagation_headers":{"sentry-trace":"b505f32993044252996855c835116678-4d3bb20675944795","baggage":"sentry-trace_id=b505f32993044252996855c835116678,sentry-release=Unknown"},"correlation_id":"01KZR4V8KDPAHFYXVF8HNKWG8D","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9fdfbe2aab6a95666b215d63997404d97b314342ba2d5a20958e7e59d384c9fb","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:43.657Z","job_size_bytes":1749,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-6505c0b151eb0d0f88012e4f: start","job_status":"start","queue_duration_s":3.589452,"scheduling_latency_s":3.589478} gitlab # [ 271.682690] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.288Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"78d71ff9-a4cf-4bf5-b024-27dec8804725\"}"],"class":"WebHookWorker","jid":"6505c0b151eb0d0f88012e4f","created_at":"2026-08-11T10:11:43.656Z","trace_propagation_headers":{"sentry-trace":"b505f32993044252996855c835116678-4d3bb20675944795","baggage":"sentry-trace_id=b505f32993044252996855c835116678,sentry-release=Unknown"},"correlation_id":"01KZR4V8KDPAHFYXVF8HNKWG8D","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9fdfbe2aab6a95666b215d63997404d97b314342ba2d5a20958e7e59d384c9fb","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:43.657Z","job_size_bytes":1749,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-6505c0b151eb0d0f88012e4f: done: 0.041808 sec","job_status":"done","queue_duration_s":3.589452,"scheduling_latency_s":3.589478,"redis_calls":14,"redis_duration_s":0.004118,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000827,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001758,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001533,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.006910374999961277,"cpu_s":0.021457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.041808,"completed_at":"2026-08-11T10:11:47.288Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001826,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.806104] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.290Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"1d17cf5cc3286c94296679d2","created_at":"2026-08-11T10:11:44.273Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.278Z","job_size_bytes":23,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-1d17cf5cc3286c94296679d2: start","job_status":"start","queue_duration_s":3.012219,"scheduling_latency_s":3.01225} gitlab # [ 271.807380] nixbot[2713]: INFO: ::ffff:127.0.0.1:40434 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 271.808160] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:47 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 54 gitlab # [ 271.808975] gitaly[932]: time="2026-08-11T10:11:47.351Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=6 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4X2Z2A6G3QAHTS0YRRH3F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:11:47.336" grpc.time_ms=14.659 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 271.810176] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.360Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"1d17cf5cc3286c94296679d2","created_at":"2026-08-11T10:11:44.273Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.278Z","job_size_bytes":23,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-1d17cf5cc3286c94296679d2: done: 0.069856 sec","job_status":"done","queue_duration_s":3.012219,"scheduling_latency_s":3.01225,"redis_calls":10,"redis_duration_s":0.002685,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000485,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001664,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000536,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000710984,"duration_s":0.069856,"completed_at":"2026-08-11T10:11:47.360Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010121,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 271.873552] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.362Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a8bcd14d7ba55a2851a68b95","created_at":"2026-08-11T10:11:44.503Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.512Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a8bcd14d7ba55a2851a68b95: start","job_status":"start","queue_duration_s":2.8504,"scheduling_latency_s":2.850423} gitlab # [ 271.946136] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.390Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a8bcd14d7ba55a2851a68b95","created_at":"2026-08-11T10:11:44.503Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.512Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a8bcd14d7ba55a2851a68b95: done: 0.028068 sec","job_status":"done","queue_duration_s":2.8504,"scheduling_latency_s":2.850423,"redis_calls":10,"redis_duration_s":0.0021650000000000003,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000406,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001347,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000441676,"duration_s":0.028068,"completed_at":"2026-08-11T10:11:47.390Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003644,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 272.026611] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.392Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"de658202a6aaddde561b8d0a","created_at":"2026-08-11T10:11:44.530Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.544Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-de658202a6aaddde561b8d0a: start","job_status":"start","queue_duration_s":2.847578,"scheduling_latency_s":2.847598} gitlab # [ 272.028478] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.494Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"de658202a6aaddde561b8d0a","created_at":"2026-08-11T10:11:44.530Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.544Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-de658202a6aaddde561b8d0a: done: 0.102266 sec","job_status":"done","queue_duration_s":2.847578,"scheduling_latency_s":2.847598,"redis_calls":10,"redis_duration_s":0.005374,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000421,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003403,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00155,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.086193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000789486,"duration_s":0.102266,"completed_at":"2026-08-11T10:11:47.494Z","load_balancing_strategy":"primary","db_duration_s":0.004397,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 272.058120] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.497Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"5126802c03ec95bd500025c1","created_at":"2026-08-11T10:11:44.568Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.576Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5126802c03ec95bd500025c1: start","job_status":"start","queue_duration_s":2.920904,"scheduling_latency_s":2.920927} gitlab # [ 272.082198] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.531Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"5126802c03ec95bd500025c1","created_at":"2026-08-11T10:11:44.568Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.576Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5126802c03ec95bd500025c1: done: 0.034685 sec","job_status":"done","queue_duration_s":2.920904,"scheduling_latency_s":2.920927,"redis_calls":13,"redis_duration_s":0.002981,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000397,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001508,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00064,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000436,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000414299,"duration_s":0.034685,"completed_at":"2026-08-11T10:11:47.531Z","load_balancing_strategy":"primary","db_duration_s":0.004532,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 272.152970] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.533Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4ebcc9607e65fcd3cb040497","created_at":"2026-08-11T10:11:44.577Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.585Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4ebcc9607e65fcd3cb040497: start","job_status":"start","queue_duration_s":2.948039,"scheduling_latency_s":2.948101} gitlab # [ 272.225442] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.566Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4ebcc9607e65fcd3cb040497","created_at":"2026-08-11T10:11:44.577Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.585Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4ebcc9607e65fcd3cb040497: done: 0.033256 sec","job_status":"done","queue_duration_s":2.948039,"scheduling_latency_s":2.948101,"redis_calls":10,"redis_duration_s":0.003818,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000481,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000651,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000372673,"duration_s":0.033256,"completed_at":"2026-08-11T10:11:47.566Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003888,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 272.246082] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.569Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"21086c93b623c019d1e0a49a","created_at":"2026-08-11T10:11:44.586Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.595Z","job_size_bytes":19,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-21086c93b623c019d1e0a49a: start","job_status":"start","queue_duration_s":2.974845,"scheduling_latency_s":2.974868} gitlab # [ 272.271584] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.597Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"21086c93b623c019d1e0a49a","created_at":"2026-08-11T10:11:44.586Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.595Z","job_size_bytes":19,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-21086c93b623c019d1e0a49a: done: 0.028023 sec","job_status":"done","queue_duration_s":2.974845,"scheduling_latency_s":2.974868,"redis_calls":11,"redis_duration_s":0.002643,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000481,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001611,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000551,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000350603,"duration_s":0.028023,"completed_at":"2026-08-11T10:11:47.597Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002929,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 272.366493] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.599Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"6f080dc06d091f3678266fdc","created_at":"2026-08-11T10:11:44.598Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.602Z","job_size_bytes":66,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-6f080dc06d091f3678266fdc: start","job_status":"start","queue_duration_s":2.996464,"scheduling_latency_s":2.996485} gitlab # [ 272.367982] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.657Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"6f080dc06d091f3678266fdc","created_at":"2026-08-11T10:11:44.598Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.602Z","job_size_bytes":66,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-6f080dc06d091f3678266fdc: done: 0.058618 sec","job_status":"done","queue_duration_s":2.996464,"scheduling_latency_s":2.996485,"redis_calls":10,"redis_duration_s":0.003895,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000552,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002903,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001086171,"duration_s":0.058618,"completed_at":"2026-08-11T10:11:47.657Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031177,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 272.436237] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.660Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"df730efb4c5215eb95d7e0e7","created_at":"2026-08-11T10:11:44.604Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.608Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-df730efb4c5215eb95d7e0e7: start","job_status":"start","queue_duration_s":3.051926,"scheduling_latency_s":3.051948} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 272.506390] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.696Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"df730efb4c5215eb95d7e0e7","created_at":"2026-08-11T10:11:44.604Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.608Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-df730efb4c5215eb95d7e0e7: done: 0.035878 sec","job_status":"done","queue_duration_s":3.051926,"scheduling_latency_s":3.051948,"redis_calls":10,"redis_duration_s":0.002424,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000431,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001554,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000396699,"duration_s":0.035878,"completed_at":"2026-08-11T10:11:47.696Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006794,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 272.529274] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.697Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"22afcf7ca95be8609757bc63","created_at":"2026-08-11T10:11:44.615Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.619Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-22afcf7ca95be8609757bc63: start","job_status":"start","queue_duration_s":3.078313,"scheduling_latency_s":3.078334} gitlab # [ 272.554776] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.730Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"22afcf7ca95be8609757bc63","created_at":"2026-08-11T10:11:44.615Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.619Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-22afcf7ca95be8609757bc63: done: 0.032324 sec","job_status":"done","queue_duration_s":3.078313,"scheduling_latency_s":3.078334,"redis_calls":10,"redis_duration_s":0.0023899999999999998,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000483,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001382,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000525,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000358425,"duration_s":0.032324,"completed_at":"2026-08-11T10:11:47.730Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008153,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.11 seconds) gitlab # [ 272.653451] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.732Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"aa199dd6c83bec611964a1ce","created_at":"2026-08-11T10:11:44.620Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.624Z","job_size_bytes":6,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-aa199dd6c83bec611964a1ce: start","job_status":"start","queue_duration_s":3.107646,"scheduling_latency_s":3.107667} gitlab # [ 272.655447] gitaly[932]: time="2026-08-11T10:11:48.146Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:11:48.145" grpc.time_ms=0.405 pid=932 span.kind=server system=grpc gitlab # [ 272.726897] gitaly[932]: time="2026-08-11T10:11:48.180Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:11:48.179" grpc.time_ms=1.234 pid=932 span.kind=server system=grpc gitlab # [ 272.728283] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.754Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"aa199dd6c83bec611964a1ce","created_at":"2026-08-11T10:11:44.620Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.624Z","job_size_bytes":6,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-aa199dd6c83bec611964a1ce: done: 0.02243 sec","job_status":"done","queue_duration_s":3.107646,"scheduling_latency_s":3.107667,"redis_calls":10,"redis_duration_s":0.002357,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000422,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001497,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000438,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000399772,"duration_s":0.02243,"completed_at":"2026-08-11T10:11:47.754Z","load_balancing_strategy":"primary","db_duration_s":0.00234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 272.744878] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.756Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"8f3cb08ac10e500168d5eabd","created_at":"2026-08-11T10:11:44.625Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.629Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-8f3cb08ac10e500168d5eabd: start","job_status":"start","queue_duration_s":3.126185,"scheduling_latency_s":3.126206} gitlab # [ 272.769227] gitaly[932]: time="2026-08-11T10:11:48.269Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:11:48.234" grpc.time_ms=35.597 pid=932 span.kind=server system=grpc gitlab # [ 272.784078] gitaly[932]: time="2026-08-11T10:11:48.281Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 diskcache=4287cad2-6405-40db-af9e-29cc4297e17b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:12:18.088" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:48.089" pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 272.858586] nixbot[2713]: INFO: ::ffff:127.0.0.1:40450 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab # [ 272.859915] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.792Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"8f3cb08ac10e500168d5eabd","created_at":"2026-08-11T10:11:44.625Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.629Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-8f3cb08ac10e500168d5eabd: done: 0.036241 sec","job_status":"done","queue_duration_s":3.126185,"scheduling_latency_s":3.126206,"redis_calls":10,"redis_duration_s":0.0025399999999999997,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000512,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00153,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000498,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000411225,"duration_s":0.036241,"completed_at":"2026-08-11T10:11:47.792Z","load_balancing_strategy":"primary","db_duration_s":0.007561,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 272.867457] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.828Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"5d80db45a61a569e8939ffab","created_at":"2026-08-11T10:11:44.636Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.640Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-5d80db45a61a569e8939ffab: start","job_status":"start","queue_duration_s":3.187611,"scheduling_latency_s":3.187643} gitlab # [ 272.893093] gitaly[932]: time="2026-08-11T10:11:48.281Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=81 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7041 command.oublock=0 command.real_time_ms=182 command.spawn_token_fork_ms=1 command.system_time_ms=52 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:12:18.088" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:48.089" grpc.time_ms=192.002 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 272.913329] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.941Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"5d80db45a61a569e8939ffab","created_at":"2026-08-11T10:11:44.636Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.640Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-5d80db45a61a569e8939ffab: done: 0.112941 sec","job_status":"done","queue_duration_s":3.187611,"scheduling_latency_s":3.187643,"redis_calls":14,"redis_duration_s":0.006752,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000527,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002461,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003764,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.053,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000370718,"duration_s":0.112941,"completed_at":"2026-08-11T10:11:47.941Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.060761,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 272.998340] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:47.942Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"60b0e68793d4cf0202c1c17c","created_at":"2026-08-11T10:11:44.765Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.767Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-60b0e68793d4cf0202c1c17c: start","job_status":"start","queue_duration_s":3.174931,"scheduling_latency_s":3.174953} gitlab # [ 273.070467] gitaly[932]: time="2026-08-11T10:11:48.687Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=352 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=352 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:12:18.334" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:48.334" grpc.time_ms=352.712 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 273.104648] gitaly[932]: time="2026-08-11T10:11:48.721Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:18.720" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:48.721" grpc.time_ms=0.697 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 273.131739] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:48.748Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"60b0e68793d4cf0202c1c17c","created_at":"2026-08-11T10:11:44.765Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.767Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2662,"job_status":"rescheduled","message":"PipelineProcessWorker JID-60b0e68793d4cf0202c1c17c: rescheduled"} gitlab # [ 273.170403] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:48.786Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"60b0e68793d4cf0202c1c17c","created_at":"2026-08-11T10:11:44.765Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-212acf09ac1b4643","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.767Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-60b0e68793d4cf0202c1c17c: done: 0.844221 sec","job_status":"done","queue_duration_s":3.174931,"scheduling_latency_s":3.174953,"gitaly_calls":3,"gitaly_duration_s":0.553118,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.056530000000000004,"redis_read_bytes":149,"redis_write_bytes":18011,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000708,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001035,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003634,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12310,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.028024,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00026,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000627,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.021534,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.092,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.092,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117699,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.760284617,"duration_s":0.844221,"completed_at":"2026-08-11T10:11:48.786Z","load_balancing_strategy":"primary","db_duration_s":0.113887,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 273.207175] gitaly[932]: time="2026-08-11T10:11:48.788Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4X2TP99AJ60FYR03D43FV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:11:58.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:48.780" grpc.time_ms=8.467 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 273.208364] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:48.790Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"99559ac78126522d2c3be78f","created_at":"2026-08-11T10:11:44.858Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-5b941ff34bfe4f91","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.863Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-99559ac78126522d2c3be78f: start","job_status":"start","queue_duration_s":3.926496,"scheduling_latency_s":3.926544} gitlab # [ 273.295505] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:48 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1677 gitlab # [ 273.299829] nixbot[2713]: {"ts": "2026-08-11T10:11:48.838Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba \"HTTP/1.1 201 Created\""} gitlab # [ 273.304477] gitaly[932]: time="2026-08-11T10:11:48.915Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X30V5T4WMWHKNTJ4JNF4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:11:48.789" pid=932 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 273.320449] gitlab-workhorse[831]: time="2026-08-11T10:11:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 273.323596] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1560 gitlab # [ 273.326948] gitaly[932]: time="2026-08-11T10:11:48.915Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=121 command.spawn_token_fork_ms=117 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X30V5T4WMWHKNTJ4JNF4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:11:48.789" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 273.347704] gitaly[932]: time="2026-08-11T10:11:48.915Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=121 command.spawn_token_fork_ms=117 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X30V5T4WMWHKNTJ4JNF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:11:48.789" grpc.time_ms=125.694 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 273.370060] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:48.961Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"99559ac78126522d2c3be78f","created_at":"2026-08-11T10:11:44.858Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-5b941ff34bfe4f91","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.863Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-99559ac78126522d2c3be78f: done: 0.171423 sec","job_status":"done","queue_duration_s":3.926496,"scheduling_latency_s":3.926544,"redis_calls":19,"redis_duration_s":0.007851,"redis_read_bytes":22,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001777,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.002623,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.00253,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.078,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.078,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01345562,"duration_s":0.171423,"completed_at":"2026-08-11T10:11:48.961Z","load_balancing_strategy":"primary","db_duration_s":0.082135,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 273.439152] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:48.963Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","0e0c27e3e60bdd1a08c1ae00"],"class":"WebHooks::LogExecutionWorker","jid":"dd51d5ac1ce2749cb214780a","created_at":"2026-08-11T10:11:46.302Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-a4310ddfa32f4759","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:03c9bb5ceded94f9e8a419aaee2c75fd44638761348b759595452e851e41f41e","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.308Z","job_size_bytes":2593,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-dd51d5ac1ce2749cb214780a: start","job_status":"start","queue_duration_s":2.655021,"scheduling_latency_s":2.655044} gitlab # [ 273.465241] gitaly[932]: time="2026-08-11T10:11:48.972Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X4FE856NBB111QV9ZTYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:18.771" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:48.972" grpc.time_ms=0.626 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 273.485188] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 118 gitlab # [ 273.485647] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 235 gitlab # [ 273.486830] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.003Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","0e0c27e3e60bdd1a08c1ae00"],"class":"WebHooks::LogExecutionWorker","jid":"dd51d5ac1ce2749cb214780a","created_at":"2026-08-11T10:11:46.302Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-a4310ddfa32f4759","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:03c9bb5ceded94f9e8a419aaee2c75fd44638761348b759595452e851e41f41e","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.308Z","job_size_bytes":2593,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-dd51d5ac1ce2749cb214780a: done: 0.040291 sec","job_status":"done","queue_duration_s":2.655021,"scheduling_latency_s":2.655044,"redis_calls":10,"redis_duration_s":0.004662,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001526,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002605,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000531,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000534146,"duration_s":0.040291,"completed_at":"2026-08-11T10:11:49.003Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006069,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 273.492964] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.005Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","6505c0b151eb0d0f88012e4f"],"class":"WebHooks::LogExecutionWorker","jid":"4bb925c0f8f3fad559ca2145","created_at":"2026-08-11T10:11:47.277Z","trace_propagation_headers":{"sentry-trace":"b505f32993044252996855c835116678-772c2d8b388d4932","baggage":"sentry-trace_id=b505f32993044252996855c835116678,sentry-release=Unknown"},"correlation_id":"01KZR4V8KDPAHFYXVF8HNKWG8D","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f2fe2f55ef3681df92bb0969036d716190c4117c261f0554260682a5d8021f42","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:47.279Z","job_size_bytes":2592,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-4bb925c0f8f3fad559ca2145: start","job_status":"start","queue_duration_s":1.726379,"scheduling_latency_s":1.7264} gitlab # [ 273.519882] nix-daemon[2929]: accepted connection from pid 3454, user nixbot gitlab # [ 273.521077] nixbot[2713]: {"ts": "2026-08-11T10:11:49.083Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2bc541350196ddbb8fb7e5637d7ca3f10eecb9ba \"HTTP/1.1 201 Created\""} gitlab # [ 273.524937] gitaly[932]: time="2026-08-11T10:11:49.021Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4X4FE856NBB111QV9ZTYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:11:59.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:49.013" grpc.time_ms=7.94 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 273.546108] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.031Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","6505c0b151eb0d0f88012e4f"],"class":"WebHooks::LogExecutionWorker","jid":"4bb925c0f8f3fad559ca2145","created_at":"2026-08-11T10:11:47.277Z","trace_propagation_headers":{"sentry-trace":"b505f32993044252996855c835116678-772c2d8b388d4932","baggage":"sentry-trace_id=b505f32993044252996855c835116678,sentry-release=Unknown"},"correlation_id":"01KZR4V8KDPAHFYXVF8HNKWG8D","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f2fe2f55ef3681df92bb0969036d716190c4117c261f0554260682a5d8021f42","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:47.279Z","job_size_bytes":2592,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-4bb925c0f8f3fad559ca2145: done: 0.026205 sec","job_status":"done","queue_duration_s":1.726379,"scheduling_latency_s":1.7264,"redis_calls":7,"redis_duration_s":0.0052,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003357,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001843,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026205,"completed_at":"2026-08-11T10:11:49.031Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003918,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 273.613281] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.034Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8481819d84efbda703639dd3","created_at":"2026-08-11T10:11:48.082Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.084Z","job_size_bytes":23,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8481819d84efbda703639dd3: start","job_status":"start","queue_duration_s":0.949815,"scheduling_latency_s":0.949838} gitlab # [ 273.694510] gitaly[932]: time="2026-08-11T10:11:49.074Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR4X4JWKNMMWWMJFX1CPSKN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:11:49.061" grpc.time_ms=12.58 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.04 seconds) gitlab # [ 273.696359] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.079Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8481819d84efbda703639dd3","created_at":"2026-08-11T10:11:48.082Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.084Z","job_size_bytes":23,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8481819d84efbda703639dd3: done: 0.045754 sec","job_status":"done","queue_duration_s":0.949815,"scheduling_latency_s":0.949838,"redis_calls":7,"redis_duration_s":0.004506,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003913,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000593,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045754,"completed_at":"2026-08-11T10:11:49.079Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01017,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 273.724240] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.081Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ea0b66008bcf3af470561c5d","created_at":"2026-08-11T10:11:48.287Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.290Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ea0b66008bcf3af470561c5d: start","job_status":"start","queue_duration_s":0.791217,"scheduling_latency_s":0.791242} gitlab # [ 273.750325] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.104Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ea0b66008bcf3af470561c5d","created_at":"2026-08-11T10:11:48.287Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.290Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ea0b66008bcf3af470561c5d: done: 0.023521 sec","job_status":"done","queue_duration_s":0.791217,"scheduling_latency_s":0.791242,"redis_calls":7,"redis_duration_s":0.0017399999999999998,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00122,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00052,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023521,"completed_at":"2026-08-11T10:11:49.104Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00304,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 273.817863] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.106Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"a2e25b1161feb616763eaa60","created_at":"2026-08-11T10:11:48.303Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.305Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-a2e25b1161feb616763eaa60: start","job_status":"start","queue_duration_s":0.800823,"scheduling_latency_s":0.800845} gitlab # [ 273.842798] nixbot[2713]: INFO: ::ffff:127.0.0.1:35150 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK gitlab # [ 273.845774] gitlab-workhorse[831]: time="2026-08-11T10:11:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 273.848337] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 341 gitlab # [ 273.851430] gitaly[932]: time="2026-08-11T10:11:49.373Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:11:49.372" grpc.time_ms=0.967 pid=932 span.kind=server system=grpc gitlab # [ 273.866406] gitaly[932]: time="2026-08-11T10:11:49.399Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:11:49.399" grpc.time_ms=0.344 pid=932 span.kind=server system=grpc gitlab # [ 273.882078] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.130Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"a2e25b1161feb616763eaa60","created_at":"2026-08-11T10:11:48.303Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.305Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-a2e25b1161feb616763eaa60: done: 0.023781 sec","job_status":"done","queue_duration_s":0.800823,"scheduling_latency_s":0.800845,"redis_calls":7,"redis_duration_s":0.0017170000000000002,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001154,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000563,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023781,"completed_at":"2026-08-11T10:11:49.129Z","load_balancing_strategy":"primary","db_duration_s":0.004293,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 273.978253] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.131Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"5f1c3ed2791b76f61be1c258","created_at":"2026-08-11T10:11:48.312Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.313Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5f1c3ed2791b76f61be1c258: start","job_status":"start","queue_duration_s":0.817724,"scheduling_latency_s":0.817747} gitlab # [ 273.979707] gitaly[932]: time="2026-08-11T10:11:49.417Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X4PNM1403932T7PXD990 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:11:49.409" pid=932 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 273.986849] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 55 gitlab # [ 273.989844] gitlab-workhorse[831]: time="2026-08-11T10:11:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 273.992947] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 63 gitlab # [ 273.996105] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.157Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"5f1c3ed2791b76f61be1c258","created_at":"2026-08-11T10:11:48.312Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.313Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5f1c3ed2791b76f61be1c258: done: 0.025821 sec","job_status":"done","queue_duration_s":0.817724,"scheduling_latency_s":0.817747,"redis_calls":10,"redis_duration_s":0.002168,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00113,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00063,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000408,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025821,"completed_at":"2026-08-11T10:11:49.157Z","load_balancing_strategy":"primary","db_duration_s":0.003688,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 274.118518] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.158Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"787035cf6a53005fd644dd6d","created_at":"2026-08-11T10:11:48.314Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.315Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-787035cf6a53005fd644dd6d: start","job_status":"start","queue_duration_s":0.843251,"scheduling_latency_s":0.843273} gitlab # [ 274.120059] gitaly[932]: time="2026-08-11T10:11:49.417Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X4PNM1403932T7PXD990 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:11:49.409" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 274.121420] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.180Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"787035cf6a53005fd644dd6d","created_at":"2026-08-11T10:11:48.314Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.315Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-787035cf6a53005fd644dd6d: done: 0.021813 sec","job_status":"done","queue_duration_s":0.843251,"scheduling_latency_s":0.843273,"redis_calls":7,"redis_duration_s":0.0016970000000000002,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001196,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000501,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021813,"completed_at":"2026-08-11T10:11:49.180Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003164,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 274.222948] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.181Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"ae269af586aa4036e145e1e1","created_at":"2026-08-11T10:11:48.315Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.318Z","job_size_bytes":19,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-ae269af586aa4036e145e1e1: start","job_status":"start","queue_duration_s":0.863614,"scheduling_latency_s":0.863636} gitlab # [ 274.224278] gitaly[932]: time="2026-08-11T10:11:49.418Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X4PNM1403932T7PXD990 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:11:49.409" grpc.time_ms=8.936 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 274.225106] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.204Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"ae269af586aa4036e145e1e1","created_at":"2026-08-11T10:11:48.315Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.318Z","job_size_bytes":19,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-ae269af586aa4036e145e1e1: done: 0.022375 sec","job_status":"done","queue_duration_s":0.863614,"scheduling_latency_s":0.863636,"redis_calls":8,"redis_duration_s":0.00343,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001423,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002007,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022375,"completed_at":"2026-08-11T10:11:49.204Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002745,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 274.289323] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.205Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"88c9b8b44b22d0b526368baf","created_at":"2026-08-11T10:11:48.319Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.320Z","job_size_bytes":66,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-88c9b8b44b22d0b526368baf: start","job_status":"start","queue_duration_s":0.885485,"scheduling_latency_s":0.885507} gitlab # [ 274.316352] gitaly[932]: time="2026-08-11T10:11:49.503Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4X52A72BDWW45CM4N2T3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:11:49.494" grpc.time_ms=8.392 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 274.399325] gitaly[932]: time="2026-08-11T10:11:49.568Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X543GN9GMYYH2KR01T2R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:11:49.553" pid=932 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 274.400809] nix-daemon[2929]: accepted connection from pid 3537, user nixbot gitlab # [ 274.401835] nix-daemon[2929]: accepted connection from pid 3545, user nixbot gitlab # [ 274.402988] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.224Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"88c9b8b44b22d0b526368baf","created_at":"2026-08-11T10:11:48.319Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.320Z","job_size_bytes":66,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-88c9b8b44b22d0b526368baf: done: 0.019101 sec","job_status":"done","queue_duration_s":0.885485,"scheduling_latency_s":0.885507,"redis_calls":7,"redis_duration_s":0.0015899999999999998,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001151,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019101,"completed_at":"2026-08-11T10:11:49.224Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002053,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 274.421051] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.226Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e0af4874554ac555e4b52402","created_at":"2026-08-11T10:11:48.320Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.322Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e0af4874554ac555e4b52402: start","job_status":"start","queue_duration_s":0.904448,"scheduling_latency_s":0.904471} gitlab # [ 274.473424] nixbot[2713]: {"ts": "2026-08-11T10:11:49.848Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4668ea4a0c9a47b7af58d56ac92204f3314bf81b \"HTTP/1.1 201 Created\""} gitlab # [ 274.474752] nixbot[2713]: {"ts": "2026-08-11T10:11:49.856Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-4668ea4a0c9a-4"} gitlab # [ 274.475873] nixbot[2713]: {"ts": "2026-08-11T10:11:49.973Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-4668ea4a0c9a-4", "argv0": "bwrap"} gitlab # [ 274.477077] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 246 gitlab # [ 274.477835] gitaly[932]: time="2026-08-11T10:11:49.568Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1170 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X543GN9GMYYH2KR01T2R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:11:49.553" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 274.483257] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.248Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e0af4874554ac555e4b52402","created_at":"2026-08-11T10:11:48.320Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.322Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e0af4874554ac555e4b52402: done: 0.022439 sec","job_status":"done","queue_duration_s":0.904448,"scheduling_latency_s":0.904471,"redis_calls":7,"redis_duration_s":0.001563,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000415,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022439,"completed_at":"2026-08-11T10:11:49.248Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004281,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 274.550341] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.250Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"217b7a667ef9975910c32a6c","created_at":"2026-08-11T10:11:48.322Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.323Z","job_size_bytes":6,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-217b7a667ef9975910c32a6c: start","job_status":"start","queue_duration_s":0.926594,"scheduling_latency_s":0.926627} gitlab # [ 274.574981] gitaly[932]: time="2026-08-11T10:11:49.570Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1170 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X543GN9GMYYH2KR01T2R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:11:49.553" grpc.time_ms=15.224 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 274.598233] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.263Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"217b7a667ef9975910c32a6c","created_at":"2026-08-11T10:11:48.322Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.323Z","job_size_bytes":6,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-217b7a667ef9975910c32a6c: done: 0.01347 sec","job_status":"done","queue_duration_s":0.926594,"scheduling_latency_s":0.926627,"redis_calls":7,"redis_duration_s":0.001515,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000448,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01347,"completed_at":"2026-08-11T10:11:49.263Z","load_balancing_strategy":"primary","db_duration_s":0.000358,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b' gitlab # [ 274.668247] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.265Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"f9380d25f93396e428d5f06e","created_at":"2026-08-11T10:11:48.324Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.325Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f9380d25f93396e428d5f06e: start","job_status":"start","queue_duration_s":0.939849,"scheduling_latency_s":0.939871} gitlab # [ 274.686227] gitaly[932]: time="2026-08-11T10:11:49.648Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X571B2TMPZX9KBYNW92R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:19.246" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:49.647" grpc.time_ms=0.922 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 274.706517] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.286Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"f9380d25f93396e428d5f06e","created_at":"2026-08-11T10:11:48.324Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.325Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f9380d25f93396e428d5f06e: done: 0.020943 sec","job_status":"done","queue_duration_s":0.939849,"scheduling_latency_s":0.939871,"redis_calls":7,"redis_duration_s":0.001719,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000572,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020943,"completed_at":"2026-08-11T10:11:49.286Z","load_balancing_strategy":"primary","db_duration_s":0.003378,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 274.805923] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:49.287Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"32d277f2380e2cace3231a8e","created_at":"2026-08-11T10:11:48.749Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.774Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-32d277f2380e2cace3231a8e: start","job_status":"start","queue_duration_s":0.512742,"scheduling_latency_s":0.512763} gitlab # [ 274.807608] gitaly[932]: time="2026-08-11T10:11:49.665Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4X571B2TMPZX9KBYNW92R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-11T10:12:19.257" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:49.658" grpc.time_ms=6.851 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 274.814853] gitaly[932]: time="2026-08-11T10:11:49.680Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4X571B2TMPZX9KBYNW92R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:11:59.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:49.674" grpc.time_ms=5.391 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 274.835535] gitaly[932]: time="2026-08-11T10:11:49.699Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X571B2TMPZX9KBYNW92R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T10:11:59.028" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:11:49.698" grpc.time_ms=0.183 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 274.852916] gitaly[932]: time="2026-08-11T10:11:49.711Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X571B2TMPZX9KBYNW92R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T10:11:59.034" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:49.704" grpc.time_ms=6.515 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 274.873427] gitaly[932]: time="2026-08-11T10:11:49.744Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4X571B2TMPZX9KBYNW92R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:11:49.743" grpc.time_ms=0.401 pid=932 span.kind=server system=grpc gitlab # [ 274.888800] gitaly[932]: time="2026-08-11T10:11:49.769Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4X571B2TMPZX9KBYNW92R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:11:49.768" grpc.time_ms=0.356 pid=932 span.kind=server system=grpc gitlab # [ 274.962261] gitaly[932]: time="2026-08-11T10:11:49.778Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X571B2TMPZX9KBYNW92R diskcache=1efd2b9c-bd75-4517-a07c-846f84ea9d25 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:11:59.042" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:11:49.713" pid=932 ref=refs/keep-around/4668ea4a0c9a47b7af58d56ac92204f3314bf81b remote_ip="2001:db8:1::1" revision=4668ea4a0c9a47b7af58d56ac92204f3314bf81b span.kind=server system=grpc username=root gitlab # [ 274.963807] gitaly[932]: time="2026-08-11T10:11:49.779Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=59 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5027 command.oublock=8 command.real_time_ms=58 command.spawn_token_fork_ms=0 command.system_time_ms=39 command.user_time_ms=20 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X571B2TMPZX9KBYNW92R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:11:59.042" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:11:49.713" grpc.time_ms=65.819 pid=932 ref=refs/keep-around/4668ea4a0c9a47b7af58d56ac92204f3314bf81b remote_ip="2001:db8:1::1" revision=4668ea4a0c9a47b7af58d56ac92204f3314bf81b span.kind=server system=grpc username=root gitlab # [ 274.964895] gitaly[932]: time="2026-08-11T10:11:49.783Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X571B2TMPZX9KBYNW92R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:19.582" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:49.782" grpc.time_ms=0.404 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b', in 0.31 seconds) gitlab # [ 275.045231] nixbot[2713]: INFO: ::ffff:127.0.0.1:35154 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 200 OK (finished: subtest: push delivers the webhook, in 63.44 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4668ea4a0c9a47b7af58d56ac92204f3314bf81b/statuses gitlab # [ 275.059640] gitaly[932]: time="2026-08-11T10:11:50.676Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:11:50.676" grpc.time_ms=0.359 pid=932 span.kind=server system=grpc gitlab # [ 275.076654] gitaly[932]: time="2026-08-11T10:11:50.693Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:12:19.347" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:49.348" operations="[repack_refs]" pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 275.092181] gitaly[932]: time="2026-08-11T10:11:50.697Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:12:19.347" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:49.348" pid=932 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-11 10:10:41.44754778 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root gitlab # [ 275.111783] gitaly[932]: time="2026-08-11T10:11:50.717Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 diskcache=8843d436-601e-42ca-b372-dda757cea9fd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:12:19.347" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:49.348" pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 275.112347] gitaly[932]: time="2026-08-11T10:11:50.717Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=92 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=823296 command.minflt=7574 command.oublock=0 command.real_time_ms=1347 command.spawn_token_fork_ms=7 command.system_time_ms=62 command.user_time_ms=30 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:12:19.347" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:49.348" grpc.time_ms=1369.497 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 275.116289] nix-daemon[2929]: accepted connection from pid 3566, user nixbot gitlab # [ 275.154600] gitaly[932]: time="2026-08-11T10:11:50.771Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:12:20.770" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:50.770" grpc.time_ms=1.278 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 275.158194] gitaly[932]: time="2026-08-11T10:11:50.775Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X69G0YTT8PZ4GFSZF4CZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:20.574" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:50.774" grpc.time_ms=0.408 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 275.158934] gitaly[932]: time="2026-08-11T10:11:50.776Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:12:19.347" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:49.348" pid=932 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root gitlab # [ 275.162985] gitaly[932]: time="2026-08-11T10:11:50.776Z" level=info msg="optimized repository" clean_stale_data_time=76.833228ms clean_work_trees_time="93.028µs" commit_graph_time="7.822µs" correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="8.381µs" pid=932 prune_time="14.247µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="8.661µs" storage_name=default system=housekeeping total_time=77.242778ms gitlab # [ 275.163769] gitaly[932]: time="2026-08-11T10:11:50.776Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:12:19.347" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:49.348" pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 275.187408] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4668ea4a0c9a47b7af58d56ac92204f3314bf81b/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 100 gitlab # [ 275.192612] gitaly[932]: time="2026-08-11T10:11:50.809Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4V9Q56FPP54ME66SFWMH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:20.808" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:50.809" grpc.time_ms=0.578 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4668ea4a0c9a47b7af58d56ac92204f3314bf81b/statuses, in 0.21 seconds) gitlab # [ 275.271956] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:50.888Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"32d277f2380e2cace3231a8e","created_at":"2026-08-11T10:11:48.749Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.774Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2662,"job_status":"rescheduled","message":"PipelineProcessWorker JID-32d277f2380e2cace3231a8e: rescheduled"} gitlab # [ 275.279409] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:50.896Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"32d277f2380e2cace3231a8e","created_at":"2026-08-11T10:11:48.749Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-6cc05e1b29254154","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.774Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-32d277f2380e2cace3231a8e: done: 1.608898 sec","job_status":"done","queue_duration_s":0.512742,"scheduling_latency_s":0.512763,"gitaly_calls":3,"gitaly_duration_s":1.448306,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.018203,"redis_read_bytes":150,"redis_write_bytes":18013,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000491,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00263,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.004123,"redis_queues_read_bytes":28,"redis_queues_write_bytes":12312,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.006539,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000238,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000757,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002934,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.109954,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":1.573762028,"duration_s":1.608898,"completed_at":"2026-08-11T10:11:50.896Z","load_balancing_strategy":"primary","db_duration_s":0.032104,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 275.305224] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:50.898Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"a22c3b79a13a30b52366fc1b","created_at":"2026-08-11T10:11:48.941Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-98be6259e1774dd4","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.950Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-a22c3b79a13a30b52366fc1b: start","job_status":"start","queue_duration_s":1.947205,"scheduling_latency_s":1.947234} gitlab # [ 275.380255] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:50.984Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"a22c3b79a13a30b52366fc1b","created_at":"2026-08-11T10:11:48.941Z","trace_propagation_headers":{"sentry-trace":"3495e96f863c4e62951af748befa032e-98be6259e1774dd4","baggage":"sentry-trace_id=3495e96f863c4e62951af748befa032e,sentry-release=Unknown"},"correlation_id":"01KZR4V414QXZP0NV7APADZ6CA","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:48.950Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-a22c3b79a13a30b52366fc1b: done: 0.085837 sec","job_status":"done","queue_duration_s":1.947205,"scheduling_latency_s":1.947234,"redis_calls":11,"redis_duration_s":0.002847,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000487,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001918,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000442,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000573816,"duration_s":0.085837,"completed_at":"2026-08-11T10:11:50.983Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022137,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 275.400168] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:50.985Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e97f8b221589931fafac3137","created_at":"2026-08-11T10:11:49.337Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:49.340Z","job_size_bytes":23,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e97f8b221589931fafac3137: start","job_status":"start","queue_duration_s":1.645001,"scheduling_latency_s":1.645024} gitlab # [ 275.482458] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.023Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e97f8b221589931fafac3137","created_at":"2026-08-11T10:11:49.337Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:49.340Z","job_size_bytes":23,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e97f8b221589931fafac3137: done: 0.037571 sec","job_status":"done","queue_duration_s":1.645001,"scheduling_latency_s":1.645024,"redis_calls":7,"redis_duration_s":0.001947,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001523,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000424,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037571,"completed_at":"2026-08-11T10:11:51.023Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00637,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 275.495289] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.024Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"78422177dd6d32f3ceff891b","created_at":"2026-08-11T10:11:49.784Z","trace_propagation_headers":{"sentry-trace":"a3332a64ed4645039d23bd2febb3e4bc-3a651c4d2a024156","baggage":"sentry-trace_id=a3332a64ed4645039d23bd2febb3e4bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4X571B2TMPZX9KBYNW92R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:49.788Z","job_size_bytes":65,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-78422177dd6d32f3ceff891b: start","job_status":"start","queue_duration_s":1.235745,"scheduling_latency_s":1.235768} gitlab # [ 275.517290] nix-daemon[2929]: accepted connection from pid 3585, user nixbot gitlab # [ 275.518427] nix-daemon[2929]: accepted connection from pid 3594, user nixbot gitlab # [ 275.519946] nix-daemon[2929]: accepted connection from pid 3566, user nixbot gitlab # [ 275.521154] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.050Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"78422177dd6d32f3ceff891b","created_at":"2026-08-11T10:11:49.784Z","trace_propagation_headers":{"sentry-trace":"a3332a64ed4645039d23bd2febb3e4bc-3a651c4d2a024156","baggage":"sentry-trace_id=a3332a64ed4645039d23bd2febb3e4bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4X571B2TMPZX9KBYNW92R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:49.788Z","job_size_bytes":65,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-78422177dd6d32f3ceff891b: done: 0.026101 sec","job_status":"done","queue_duration_s":1.235745,"scheduling_latency_s":1.235768,"redis_calls":7,"redis_duration_s":0.001673,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001223,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00045,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026101,"completed_at":"2026-08-11T10:11:51.050Z","load_balancing_strategy":"primary","db_duration_s":0.003856,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 275.588559] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.052Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6e2c3cc8d493936329d6cdda","created_at":"2026-08-11T10:11:49.790Z","trace_propagation_headers":{"sentry-trace":"a3332a64ed4645039d23bd2febb3e4bc-3a651c4d2a024156","baggage":"sentry-trace_id=a3332a64ed4645039d23bd2febb3e4bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4X571B2TMPZX9KBYNW92R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:49.792Z","job_size_bytes":65,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6e2c3cc8d493936329d6cdda: start","job_status":"start","queue_duration_s":1.260006,"scheduling_latency_s":1.26003} gitlab # [ 275.616245] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.103Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6e2c3cc8d493936329d6cdda","created_at":"2026-08-11T10:11:49.790Z","trace_propagation_headers":{"sentry-trace":"a3332a64ed4645039d23bd2febb3e4bc-3a651c4d2a024156","baggage":"sentry-trace_id=a3332a64ed4645039d23bd2febb3e4bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4X571B2TMPZX9KBYNW92R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:49.792Z","job_size_bytes":65,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6e2c3cc8d493936329d6cdda: done: 0.051072 sec","job_status":"done","queue_duration_s":1.260006,"scheduling_latency_s":1.26003,"redis_calls":10,"redis_duration_s":0.007509999999999999,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004768,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.002742,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051072,"completed_at":"2026-08-11T10:11:51.103Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011539,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 275.690933] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.106Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"69e67d1e236e869afd181f2a","created_at":"2026-08-11T10:11:49.831Z","trace_propagation_headers":{"sentry-trace":"a3332a64ed4645039d23bd2febb3e4bc-3a651c4d2a024156","baggage":"sentry-trace_id=a3332a64ed4645039d23bd2febb3e4bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4X571B2TMPZX9KBYNW92R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:49.835Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-69e67d1e236e869afd181f2a: start","job_status":"start","queue_duration_s":1.270788,"scheduling_latency_s":1.270812} gitlab # [ 275.743080] gitaly[932]: time="2026-08-11T10:11:51.360Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4X571B2TMPZX9KBYNW92R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:12:21.359" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:51.359" grpc.time_ms=0.775 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 275.793544] gitaly[932]: time="2026-08-11T10:11:51.410Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X571B2TMPZX9KBYNW92R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:21.409" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:51.409" grpc.time_ms=0.694 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 275.808261] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.424Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"69e67d1e236e869afd181f2a","created_at":"2026-08-11T10:11:49.831Z","trace_propagation_headers":{"sentry-trace":"a3332a64ed4645039d23bd2febb3e4bc-3a651c4d2a024156","baggage":"sentry-trace_id=a3332a64ed4645039d23bd2febb3e4bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4X571B2TMPZX9KBYNW92R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:49.835Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-69e67d1e236e869afd181f2a: done: 0.318402 sec","job_status":"done","queue_duration_s":1.270788,"scheduling_latency_s":1.270812,"gitaly_calls":2,"gitaly_duration_s":0.026911,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.084561,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.037695,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001129,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000311,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001821,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.004329,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000577,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.161,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.119,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083846,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.285176188,"duration_s":0.318402,"completed_at":"2026-08-11T10:11:51.424Z","load_balancing_strategy":"primary","db_duration_s":0.273764,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 275.824267] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.431Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"6beb1947f29fbbe0a9d0b53d","created_at":"2026-08-11T10:11:50.724Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.726Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-6beb1947f29fbbe0a9d0b53d: start","job_status":"start","queue_duration_s":0.704159,"scheduling_latency_s":0.704185} gitlab # [ 275.849981] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.463Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"6beb1947f29fbbe0a9d0b53d","created_at":"2026-08-11T10:11:50.724Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.726Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-6beb1947f29fbbe0a9d0b53d: done: 0.032798 sec","job_status":"done","queue_duration_s":0.704159,"scheduling_latency_s":0.704185,"redis_calls":7,"redis_duration_s":0.005051,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003777,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032798,"completed_at":"2026-08-11T10:11:51.463Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 275.969626] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.467Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"14e7a196c9718787c0c1a6cd","created_at":"2026-08-11T10:11:50.737Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.739Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-14e7a196c9718787c0c1a6cd: start","job_status":"start","queue_duration_s":0.727682,"scheduling_latency_s":0.727706} gitlab # [ 275.971126] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.500Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"14e7a196c9718787c0c1a6cd","created_at":"2026-08-11T10:11:50.737Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.739Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-14e7a196c9718787c0c1a6cd: done: 0.032994 sec","job_status":"done","queue_duration_s":0.727682,"scheduling_latency_s":0.727706,"redis_calls":7,"redis_duration_s":0.003882,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003281,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000601,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032994,"completed_at":"2026-08-11T10:11:51.499Z","load_balancing_strategy":"primary","db_duration_s":0.007359,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.005458] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.501Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1972925e7324629c6a6de4e5","created_at":"2026-08-11T10:11:50.746Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.747Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1972925e7324629c6a6de4e5: start","job_status":"start","queue_duration_s":0.753856,"scheduling_latency_s":0.753888} gitlab # [ 276.030077] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.530Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1972925e7324629c6a6de4e5","created_at":"2026-08-11T10:11:50.746Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.747Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1972925e7324629c6a6de4e5: done: 0.029269 sec","job_status":"done","queue_duration_s":0.753856,"scheduling_latency_s":0.753888,"redis_calls":10,"redis_duration_s":0.002209,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000655,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000445,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029269,"completed_at":"2026-08-11T10:11:51.530Z","load_balancing_strategy":"primary","db_duration_s":0.004454,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.111087] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.532Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a84d3b90e8b9a4dc15b48547","created_at":"2026-08-11T10:11:50.748Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.749Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a84d3b90e8b9a4dc15b48547: start","job_status":"start","queue_duration_s":0.782722,"scheduling_latency_s":0.782774} gitlab # [ 276.121477] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.554Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a84d3b90e8b9a4dc15b48547","created_at":"2026-08-11T10:11:50.748Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.749Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a84d3b90e8b9a4dc15b48547: done: 0.021652 sec","job_status":"done","queue_duration_s":0.782722,"scheduling_latency_s":0.782774,"redis_calls":7,"redis_duration_s":0.001645,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00116,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000485,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021652,"completed_at":"2026-08-11T10:11:51.554Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003178,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4668ea4a0c9a47b7af58d56ac92204f3314bf81b/statuses gitlab # [ 276.250355] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.555Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7254f7e44fcb14eb78e12efb","created_at":"2026-08-11T10:11:50.750Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.752Z","job_size_bytes":19,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7254f7e44fcb14eb78e12efb: start","job_status":"start","queue_duration_s":0.803091,"scheduling_latency_s":0.803143} gitlab # [ 276.251825] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.575Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7254f7e44fcb14eb78e12efb","created_at":"2026-08-11T10:11:50.750Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.752Z","job_size_bytes":19,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7254f7e44fcb14eb78e12efb: done: 0.020268 sec","job_status":"done","queue_duration_s":0.803091,"scheduling_latency_s":0.803143,"redis_calls":8,"redis_duration_s":0.001755,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00134,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000415,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020268,"completed_at":"2026-08-11T10:11:51.575Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002624,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4668ea4a0c9a47b7af58d56ac92204f3314bf81b/statuses, in 0.10 seconds) gitlab # [ 276.277782] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.577Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"fbf889e047173f1a93a9a307","created_at":"2026-08-11T10:11:50.753Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.754Z","job_size_bytes":66,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-fbf889e047173f1a93a9a307: start","job_status":"start","queue_duration_s":0.822307,"scheduling_latency_s":0.822329} gitlab # [ 276.305324] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.596Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"fbf889e047173f1a93a9a307","created_at":"2026-08-11T10:11:50.753Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.754Z","job_size_bytes":66,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-fbf889e047173f1a93a9a307: done: 0.01908 sec","job_status":"done","queue_duration_s":0.822307,"scheduling_latency_s":0.822329,"redis_calls":7,"redis_duration_s":0.001556,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000422,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01908,"completed_at":"2026-08-11T10:11:51.596Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002158,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.391213] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.597Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"4117ef2c55574d78dae4dbee","created_at":"2026-08-11T10:11:50.755Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.756Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4117ef2c55574d78dae4dbee: start","job_status":"start","queue_duration_s":0.840679,"scheduling_latency_s":0.840701} gitlab # [ 276.396234] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.619Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"4117ef2c55574d78dae4dbee","created_at":"2026-08-11T10:11:50.755Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.756Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4117ef2c55574d78dae4dbee: done: 0.022049 sec","job_status":"done","queue_duration_s":0.840679,"scheduling_latency_s":0.840701,"redis_calls":7,"redis_duration_s":0.001559,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00114,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000419,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022049,"completed_at":"2026-08-11T10:11:51.619Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004285,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.462935] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.621Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"409147fdf795b08537c655c3","created_at":"2026-08-11T10:11:50.757Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.758Z","job_size_bytes":6,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-409147fdf795b08537c655c3: start","job_status":"start","queue_duration_s":0.862434,"scheduling_latency_s":0.862454} gitlab # [ 276.531639] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4668ea4a0c9a47b7af58d56ac92204f3314bf81b/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 58 gitlab # [ 276.533729] gitaly[932]: time="2026-08-11T10:11:51.954Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X7FC06J3Z586A2737FWJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:21.753" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:51.953" grpc.time_ms=0.694 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 276.534824] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.634Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"409147fdf795b08537c655c3","created_at":"2026-08-11T10:11:50.757Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.758Z","job_size_bytes":6,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-409147fdf795b08537c655c3: done: 0.013304 sec","job_status":"done","queue_duration_s":0.862434,"scheduling_latency_s":0.862454,"redis_calls":7,"redis_duration_s":0.0015220000000000001,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008668,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013304,"completed_at":"2026-08-11T10:11:51.634Z","load_balancing_strategy":"primary","db_duration_s":0.000395,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.576257] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.635Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"61c1703d7c962dadd49e8950","created_at":"2026-08-11T10:11:50.759Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.760Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-61c1703d7c962dadd49e8950: start","job_status":"start","queue_duration_s":0.874702,"scheduling_latency_s":0.874723} gitlab # [ 276.600497] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.655Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"61c1703d7c962dadd49e8950","created_at":"2026-08-11T10:11:50.759Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.760Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-61c1703d7c962dadd49e8950: done: 0.019599 sec","job_status":"done","queue_duration_s":0.874702,"scheduling_latency_s":0.874723,"redis_calls":7,"redis_duration_s":0.0017000000000000001,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001286,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000414,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019599,"completed_at":"2026-08-11T10:11:51.655Z","load_balancing_strategy":"primary","db_duration_s":0.002711,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.672391] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.656Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4a0733c4bd17b49b73986973","created_at":"2026-08-11T10:11:50.889Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.891Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4a0733c4bd17b49b73986973: start","job_status":"start","queue_duration_s":0.76544,"scheduling_latency_s":0.765461} gitlab # [ 276.687832] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.678Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4a0733c4bd17b49b73986973","created_at":"2026-08-11T10:11:50.889Z","trace_propagation_headers":{"sentry-trace":"249e70f77392469f83caacfdf1caf9bc-3cfaf1d7cb0c4263","baggage":"sentry-trace_id=249e70f77392469f83caacfdf1caf9bc,sentry-release=Unknown"},"correlation_id":"01KZR4V9Q56FPP54ME66SFWMH7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:50.891Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4a0733c4bd17b49b73986973: done: 0.021646 sec","job_status":"done","queue_duration_s":0.76544,"scheduling_latency_s":0.765461,"redis_calls":8,"redis_duration_s":0.001907,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001494,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000413,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021646,"completed_at":"2026-08-11T10:11:51.678Z","load_balancing_strategy":"primary","db_duration_s":0.002865,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 276.812496] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.679Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"ef11daa2cd114ec81a15603b","created_at":"2026-08-11T10:11:51.344Z","trace_propagation_headers":{"sentry-trace":"a3332a64ed4645039d23bd2febb3e4bc-b067c83f67dd4db6","baggage":"sentry-trace_id=a3332a64ed4645039d23bd2febb3e4bc,sentry-release=Unknown"},"correlation_id":"01KZR4X571B2TMPZX9KBYNW92R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:51.346Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ef11daa2cd114ec81a15603b: start","job_status":"start","queue_duration_s":0.333022,"scheduling_latency_s":0.333045} gitlab # [ 276.814068] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:51.706Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"ef11daa2cd114ec81a15603b","created_at":"2026-08-11T10:11:51.344Z","trace_propagation_headers":{"sentry-trace":"a3332a64ed4645039d23bd2febb3e4bc-b067c83f67dd4db6","baggage":"sentry-trace_id=a3332a64ed4645039d23bd2febb3e4bc,sentry-release=Unknown"},"correlation_id":"01KZR4X571B2TMPZX9KBYNW92R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:51.346Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ef11daa2cd114ec81a15603b: done: 0.026567 sec","job_status":"done","queue_duration_s":0.333022,"scheduling_latency_s":0.333045,"redis_calls":7,"redis_duration_s":0.0015860000000000002,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001157,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000429,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026567,"completed_at":"2026-08-11T10:11:51.706Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.969805] gitaly[932]: time="2026-08-11T10:11:52.586Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X82T48A6Y6TPH10JSDVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:22.384" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:52.585" grpc.time_ms=0.759 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 277.013695] gitaly[932]: time="2026-08-11T10:11:52.630Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR4X82T48A6Y6TPH10JSDVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:12:02.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:52.617" grpc.time_ms=13.05 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 277.047843] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:52.664Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e1db92114da8b8354c756616","created_at":"2026-08-11T10:11:52.659Z","trace_propagation_headers":{"sentry-trace":"30999fb429054f6c91182d000c0504ea-ed7db87a436f4417","baggage":"sentry-trace_id=30999fb429054f6c91182d000c0504ea,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4X82T48A6Y6TPH10JSDVS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:52.662Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e1db92114da8b8354c756616: start","job_status":"start","queue_duration_s":0.002011,"scheduling_latency_s":0.002056} gitlab # [ 277.074578] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 152 gitlab # [ 277.079938] nixbot[2713]: {"ts": "2026-08-11T10:11:52.693Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4668ea4a0c9a47b7af58d56ac92204f3314bf81b \"HTTP/1.1 201 Created\""} gitlab # [ 277.149894] gitaly[932]: time="2026-08-11T10:11:52.767Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X87XXBP2GQ8CQHAYAGC1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:22.565" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:52.766" grpc.time_ms=0.741 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 277.178323] gitaly[932]: time="2026-08-11T10:11:52.795Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4X82T48A6Y6TPH10JSDVS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:11:52.795" grpc.time_ms=0.36 pid=932 span.kind=server system=grpc gitlab # [ 277.193432] gitaly[932]: time="2026-08-11T10:11:52.804Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4X87XXBP2GQ8CQHAYAGC1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:12:02.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:52.796" grpc.time_ms=7.056 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 277.218821] gitaly[932]: time="2026-08-11T10:11:52.836Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4X82T48A6Y6TPH10JSDVS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:11:52.834" grpc.time_ms=1.087 pid=932 span.kind=server system=grpc gitlab # [ 277.240873] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 156 gitlab # [ 277.243919] nixbot[2713]: {"ts": "2026-08-11T10:11:52.859Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4668ea4a0c9a47b7af58d56ac92204f3314bf81b \"HTTP/1.1 201 Created\""} gitlab # [ 277.253694] gitaly[932]: time="2026-08-11T10:11:52.871Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4X82T48A6Y6TPH10JSDVS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:11:52.870" grpc.time_ms=0.331 pid=932 span.kind=server system=grpc gitlab # [ 277.277393] gitaly[932]: time="2026-08-11T10:11:52.894Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X82T48A6Y6TPH10JSDVS diskcache=b37818d4-6ed2-4270-84cf-5ce4c1f495d0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:12:22.763" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:52.763" pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 277.292727] gitaly[932]: time="2026-08-11T10:11:52.909Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=97 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7039 command.oublock=0 command.real_time_ms=124 command.spawn_token_fork_ms=0 command.system_time_ms=69 command.user_time_ms=28 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X82T48A6Y6TPH10JSDVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:12:22.763" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:52.763" grpc.time_ms=131.355 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 277.314455] gitaly[932]: time="2026-08-11T10:11:52.931Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X8D932G9C8K8M3GDKJ6P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:22.730" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:52.930" grpc.time_ms=0.667 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4668ea4a0c9a47b7af58d56ac92204f3314bf81b/statuses gitlab # [ 277.347102] gitaly[932]: time="2026-08-11T10:11:52.964Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4X82T48A6Y6TPH10JSDVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:12:22.062" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:52.963" grpc.time_ms=0.96 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 277.389139] gitaly[932]: time="2026-08-11T10:11:53.006Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X82T48A6Y6TPH10JSDVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:23.004" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:53.004" grpc.time_ms=0.783 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 277.408459] gitaly[932]: time="2026-08-11T10:11:53.009Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR4X8D932G9C8K8M3GDKJ6P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:12:02.229" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:11:53.000" grpc.time_ms=9.621 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 277.429599] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:53.018Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"05e57a240b18bac54c96122b","created_at":"2026-08-11T10:11:53.016Z","trace_propagation_headers":{"sentry-trace":"30999fb429054f6c91182d000c0504ea-cdc5f19ee5d24705","baggage":"sentry-trace_id=30999fb429054f6c91182d000c0504ea,sentry-release=Unknown"},"correlation_id":"01KZR4X82T48A6Y6TPH10JSDVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"e1db92114da8b8354c756616","job_size_bytes":3,"pid":2662,"job_status":"deduplicated","message":"PipelineProcessWorker JID-05e57a240b18bac54c96122b: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 277.430150] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:53.021Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e1db92114da8b8354c756616","created_at":"2026-08-11T10:11:52.659Z","trace_propagation_headers":{"sentry-trace":"30999fb429054f6c91182d000c0504ea-ed7db87a436f4417","baggage":"sentry-trace_id=30999fb429054f6c91182d000c0504ea,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4X82T48A6Y6TPH10JSDVS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:52.662Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2662,"job_status":"rescheduled","message":"PipelineProcessWorker JID-e1db92114da8b8354c756616: rescheduled"} gitlab # [ 277.432622] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:53.034Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e1db92114da8b8354c756616","created_at":"2026-08-11T10:11:52.659Z","trace_propagation_headers":{"sentry-trace":"30999fb429054f6c91182d000c0504ea-ed7db87a436f4417","baggage":"sentry-trace_id=30999fb429054f6c91182d000c0504ea,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4X82T48A6Y6TPH10JSDVS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:52.662Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e1db92114da8b8354c756616: done: 0.369894 sec","job_status":"done","queue_duration_s":0.002011,"scheduling_latency_s":0.002056,"gitaly_calls":3,"gitaly_duration_s":0.156763,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.029087,"redis_read_bytes":239,"redis_write_bytes":21785,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002002,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002292,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.004121,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14470,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.011429,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000404,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000878,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.005959,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.012,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.015,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.139174,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.316859544,"duration_s":0.369894,"completed_at":"2026-08-11T10:11:53.034Z","load_balancing_strategy":"primary","db_duration_s":0.053853,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 277.488384] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:53.037Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"41f1b8de266d3f45cf28c698","created_at":"2026-08-11T10:11:52.755Z","trace_propagation_headers":{"sentry-trace":"30999fb429054f6c91182d000c0504ea-cdc5f19ee5d24705","baggage":"sentry-trace_id=30999fb429054f6c91182d000c0504ea,sentry-release=Unknown"},"correlation_id":"01KZR4X82T48A6Y6TPH10JSDVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:52.757Z","job_size_bytes":23,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-41f1b8de266d3f45cf28c698: start","job_status":"start","queue_duration_s":0.279941,"scheduling_latency_s":0.27997} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4668ea4a0c9a47b7af58d56ac92204f3314bf81b/statuses, in 0.23 seconds) (finished: subtest: eval and build post commit statuses, in 2.54 seconds) (finished: run the VM test script, in 314.34 seconds) gitlab # [ 277.514145] gitaly[932]: time="2026-08-11T10:11:53.064Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4X8HJRDC8Y18HD2R44W8S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:12:23.063" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:11:53.063" grpc.time_ms=0.678 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 277.534372] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:53 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4668ea4a0c9a47b7af58d56ac92204f3314bf81b HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 191 gitlab # [ 277.537756] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:53.090Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"41f1b8de266d3f45cf28c698","created_at":"2026-08-11T10:11:52.755Z","trace_propagation_headers":{"sentry-trace":"30999fb429054f6c91182d000c0504ea-cdc5f19ee5d24705","baggage":"sentry-trace_id=30999fb429054f6c91182d000c0504ea,sentry-release=Unknown"},"correlation_id":"01KZR4X82T48A6Y6TPH10JSDVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:52.757Z","job_size_bytes":23,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-41f1b8de266d3f45cf28c698: done: 0.052516 sec","job_status":"done","queue_duration_s":0.279941,"scheduling_latency_s":0.27997,"redis_calls":7,"redis_duration_s":0.004083,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002952,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001131,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052516,"completed_at":"2026-08-11T10:11:53.090Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011513,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 277.640488] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:53.092Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f05e6e0253d35dba51ab90cd","created_at":"2026-08-11T10:11:52.916Z","trace_propagation_headers":{"sentry-trace":"30999fb429054f6c91182d000c0504ea-cdc5f19ee5d24705","baggage":"sentry-trace_id=30999fb429054f6c91182d000c0504ea,sentry-release=Unknown"},"correlation_id":"01KZR4X82T48A6Y6TPH10JSDVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:52.919Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f05e6e0253d35dba51ab90cd: start","job_status":"start","queue_duration_s":0.172978,"scheduling_latency_s":0.173005} gitlab # [ 277.641930] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:53.121Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f05e6e0253d35dba51ab90cd","created_at":"2026-08-11T10:11:52.916Z","trace_propagation_headers":{"sentry-trace":"30999fb429054f6c91182d000c0504ea-cdc5f19ee5d24705","baggage":"sentry-trace_id=30999fb429054f6c91182d000c0504ea,sentry-release=Unknown"},"correlation_id":"01KZR4X82T48A6Y6TPH10JSDVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:52.919Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f05e6e0253d35dba51ab90cd: done: 0.029127 sec","job_status":"done","queue_duration_s":0.172978,"scheduling_latency_s":0.173005,"redis_calls":7,"redis_duration_s":0.0016849999999999999,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001204,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029127,"completed_at":"2026-08-11T10:11:53.121Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00848,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.698294] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:53.122Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"02182ee0d042145815969de2","created_at":"2026-08-11T10:11:52.925Z","trace_propagation_headers":{"sentry-trace":"30999fb429054f6c91182d000c0504ea-cdc5f19ee5d24705","baggage":"sentry-trace_id=30999fb429054f6c91182d000c0504ea,sentry-release=Unknown"},"correlation_id":"01KZR4X82T48A6Y6TPH10JSDVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:52.927Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-02182ee0d042145815969de2: start","job_status":"start","queue_duration_s":0.194844,"scheduling_latency_s":0.194867} gitlab # [ 277.781121] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4668ea4a0c9a47b7af58d56ac92204f3314bf81b/statuses HTTP/1.1" 200 1316 "" "curl/8.21.0" 192 gitlab # [ 277.782375] gitlab-workhorse[831]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:53 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 54 gitlab # [ 277.783246] nixbot[2713]: {"ts": "2026-08-11T10:11:53.212Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4668ea4a0c9a47b7af58d56ac92204f3314bf81b \"HTTP/1.1 201 Created\""} gitlab # [ 277.784538] nix-daemon[2929]: accepted connection from pid 3657, user nixbot gitlab # [ 277.785736] gitaly[932]: time="2026-08-11T10:11:53.386Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR4X8VNM9K2JSY97K8QHT53 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:11:53.378" grpc.time_ms=7.609 pid=932 remote_ip="2001:db8:1::1" span.kind=server system=grpc test script finished in 314.62s cleanup kill QemuMachine (pid 46) gitlab # [ 277.786868] sidekiq-cluster[2662]: {"severity":"INFO","time":"2026-08-11T10:11:53.146Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"02182ee0d042145815969de2","created_at":"2026-08-11T10:11:52.925Z","trace_propagation_headers":{"sentry-trace":"30999fb429054f6c91182d000c0504ea-cdc5f19ee5d24705","baggage":"sentry-trace_id=30999fb429054f6c91182d000c0504ea,sentry-release=Unknown"},"correlation_id":"01KZR4X82T48A6Y6TPH10JSDVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:52.927Z","job_size_bytes":3,"pid":2662,"sidekiq_tid":"m81e","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-02182ee0d042145815969de2: done: 0.023603 sec","job_status":"done","queue_duration_s":0.194844,"scheduling_latency_s":0.194867,"redis_calls":7,"redis_duration_s":0.001676,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001243,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000433,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14) gitlab # " (finished: cleanup, in 1.25 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [] [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-11T10:10:46.286Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '4668ea4a0c9a47b7af58d56ac92204f3314bf81b', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-11T10:11:49.594578Z', 'started_at': '2026-08-11T10:11:49.850486Z', 'finished_at': None}] [{'id': 5, 'sha': '4668ea4a0c9a47b7af58d56ac92204f3314bf81b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T10:11:49.827Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '4668ea4a0c9a47b7af58d56ac92204f3314bf81b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T10:11:49.827Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '4668ea4a0c9a47b7af58d56ac92204f3314bf81b', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-11T10:11:49.827Z', 'started_at': None, 'finished_at': '2026-08-11T10:11:52.650Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '4668ea4a0c9a47b7af58d56ac92204f3314bf81b', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-11T10:11:52.832Z', 'started_at': None, 'finished_at': '2026-08-11T10:11:53.038Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]