vm-test-run-nixbot-gitlab
default.checks.x86_64-linux.nixbot-gitlab
· build #204
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.bm8xvdh7cH', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: 2dac2cb1-e69b-4300-900b-8f7c8f0ca27e16gitlab # Superblock backups stored on blocks:17gitlab # 32768, 98304, 163840, 22937618gitlab # 19gitlab # Allocating group tables: 0/8 done20gitlab # Writing inode tables: 0/8 done21gitlab # Creating journal (8192 blocks): done22gitlab # Writing superblocks and filesystem accounting information: 0/8 done23(finished: start all VMs, in 36.56 seconds)24gitlab: waiting for unit setup-gitlab.service25gitlab # 26gitlab: waiting for the VM to finish booting27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... ok45gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202646gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rqh61wnlw88qw9fgsnz3g7c157g8vjp1-nixos-system-gitlab-test/init regInfo=/nix/store/mhmfl8mcph3ail1m4nbyxwzzgvkq4g1m-closure-info/registration console=ttyS0,115200n8 console=tty047gitlab # [ 0.000000] BIOS-provided physical RAM map:48gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable49gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved51gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved55gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable56gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved57gitlab # [ 0.000000] NX (Execute Disable) protection: active58gitlab # [ 0.000000] APIC: Static calls initialized59gitlab # [ 0.000000] SMBIOS 2.8 present.60gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201461gitlab # [ 0.000000] DMI: Memory slots populated: 1/162gitlab # [ 0.000000] Hypervisor detected: KVM63gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000064gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0065gitlab # [ 0.000001] kvm-clock: using sched offset of 491479562 cycles66gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns67gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor68gitlab # [ 0.000804] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000069gitlab # [ 0.000849] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs70gitlab # [ 0.000852] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT71gitlab # [ 0.000904] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000072gitlab # [ 0.002754] found SMP MP-table at [mem 0x000f5470-0x000f547f]73gitlab # [ 0.002765] Using GB pages for direct mapping74gitlab # [ 0.002874] RAMDISK: [mem 0xbe31c000-0xbffcffff]75gitlab # [ 0.002883] ACPI: Early table checksum verification disabled76gitlab # [ 0.002886] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )77gitlab # [ 0.002890] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002894] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002901] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)80gitlab # [ 0.002903] ACPI: FACS 0x00000000BFFE0000 00004081gitlab # [ 0.002904] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002906] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002907] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)84gitlab # [ 0.002909] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]85gitlab # [ 0.002910] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]86gitlab # [ 0.002910] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]87gitlab # [ 0.002911] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]88gitlab # [ 0.002911] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]89gitlab # [ 0.002912] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]90gitlab # [ 0.003387] No NUMA configuration found91gitlab # [ 0.003388] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]92gitlab # [ 0.003392] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]93gitlab # [ 0.005958] Zone ranges:94gitlab # [ 0.005959] DMA [mem 0x0000000000001000-0x0000000000ffffff]95gitlab # [ 0.005961] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]96gitlab # [ 0.005963] Normal [mem 0x0000000100000000-0x00000001bfffffff]97gitlab # [ 0.005964] Device empty98gitlab # [ 0.005964] Movable zone start for each node99gitlab # [ 0.005965] Early memory node ranges100gitlab # [ 0.005966] node 0: [mem 0x0000000000001000-0x000000000009efff]101gitlab # [ 0.005967] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]102gitlab # [ 0.005968] node 0: [mem 0x0000000100000000-0x00000001bfffffff]103gitlab # [ 0.005969] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]104gitlab # [ 0.005990] On node 0, zone DMA: 1 pages in unavailable ranges105gitlab # [ 0.006282] On node 0, zone DMA: 97 pages in unavailable ranges106gitlab # [ 0.131378] On node 0, zone Normal: 40 pages in unavailable ranges107gitlab # [ 0.132402] ACPI: PM-Timer IO Port: 0x608108gitlab # [ 0.132421] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])109gitlab # [ 0.132461] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23110gitlab # [ 0.132464] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)111gitlab # [ 0.132466] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)112gitlab # [ 0.132467] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)113gitlab # [ 0.132468] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)114gitlab # [ 0.132469] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)115gitlab # [ 0.132471] ACPI: Using ACPI (MADT) for SMP configuration information116gitlab # [ 0.132473] ACPI: HPET id: 0x8086a201 base: 0xfed00000117gitlab # [ 0.132478] TSC deadline timer available118gitlab # [ 0.132483] CPU topo: Max. logical packages: 1119gitlab # [ 0.132484] CPU topo: Max. logical dies: 1120gitlab # [ 0.132484] CPU topo: Max. dies per package: 1121gitlab # [ 0.132488] CPU topo: Max. threads per core: 1122gitlab # [ 0.132488] CPU topo: Num. cores per package: 4123gitlab # [ 0.132489] CPU topo: Num. threads per package: 4124gitlab # [ 0.132489] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs125gitlab # [ 0.132515] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()126gitlab # [ 0.132535] kvm-guest: KVM setup pv remote TLB flush127gitlab # [ 0.132538] kvm-guest: setup PV sched yield128gitlab # [ 0.132559] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]129gitlab # [ 0.132561] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]130gitlab # [ 0.132562] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]131gitlab # [ 0.132563] [mem 0xc0000000-0xfeffbfff] available for PCI devices132gitlab # [ 0.132565] Booting paravirtualized kernel on KVM133gitlab # [ 0.132568] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns134gitlab # [ 0.137064] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1135gitlab # [ 0.139591] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288136gitlab # [ 0.139645] kvm-guest: PV spinlocks enabled137gitlab # [ 0.139647] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)138gitlab # [ 0.139650] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rqh61wnlw88qw9fgsnz3g7c157g8vjp1-nixos-system-gitlab-test/init regInfo=/nix/store/mhmfl8mcph3ail1m4nbyxwzzgvkq4g1m-closure-info/registration console=ttyS0,115200n8 console=tty0139gitlab # [ 0.139750] Unknown kernel command line parameters "regInfo=/nix/store/mhmfl8mcph3ail1m4nbyxwzzgvkq4g1m-closure-info/registration", will be passed to user space.140gitlab # [ 0.139762] random: crng init done141gitlab # [ 0.139763] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes142gitlab # [ 0.148962] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)143gitlab # [ 0.153488] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)144gitlab # [ 0.153565] software IO TLB: area num 4.145gitlab # [ 0.231139] Fallback order for Node 0: 0146gitlab # [ 0.231148] Built 1 zonelists, mobility grouping on. Total pages: 1572726147gitlab # [ 0.231150] Policy zone: Normal148gitlab # [ 0.234038] mem auto-init: stack:all(zero), heap alloc:on, heap free:off149gitlab # [ 0.244284] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1150gitlab # [ 0.259932] allocated 12582912 bytes of page_ext151gitlab # [ 0.270490] ftrace: allocating 48717 entries in 192 pages152gitlab # [ 0.270492] ftrace: allocated 192 pages with 2 groups153gitlab # [ 0.271425] Dynamic Preempt: lazy154gitlab # [ 0.271644] rcu: Preemptible hierarchical RCU implementation.155gitlab # [ 0.271645] rcu: RCU event tracing is enabled.156gitlab # [ 0.271646] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.157gitlab # [ 0.271648] Trampoline variant of Tasks RCU enabled.158gitlab # [ 0.271648] Rude variant of Tasks RCU enabled.159gitlab # [ 0.271649] Tracing variant of Tasks RCU enabled.160gitlab # [ 0.271650] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.161gitlab # [ 0.271650] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4162gitlab # [ 0.271682] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.271684] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.271685] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.165gitlab # [ 0.276504] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16166gitlab # [ 0.276827] rcu: srcu_init: Setting srcu_struct sizes based on contention.167gitlab # [ 0.276841] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns168gitlab # [ 0.276964] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)169gitlab # [ 0.284690] Console: colour VGA+ 80x25170gitlab # [ 0.284695] printk: legacy console [tty0] enabled171gitlab # [ 0.330723] printk: legacy console [ttyS0] enabled172gitlab # [ 0.531614] ACPI: Core revision 20250807173gitlab # [ 0.533244] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns174gitlab # [ 0.537626] APIC: Switch to symmetric I/O mode setup175gitlab # [ 0.539487] x2apic enabled176gitlab # [ 0.540693] APIC: Switched APIC routing to: physical x2apic177gitlab # [ 0.542390] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()178gitlab # [ 0.544582] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()179gitlab # [ 0.547336] kvm-guest: setup PV IPIs180gitlab # [ 0.549670] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1181gitlab # [ 0.551506] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns182gitlab # [ 0.554579] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)183gitlab # [ 0.556695] x86/cpu: User Mode Instruction Prevention (UMIP) activated184gitlab # [ 0.557742] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127185gitlab # [ 0.559577] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0186gitlab # [ 0.561582] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto187gitlab # [ 0.563577] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl188gitlab # [ 0.565577] Transient Scheduler Attacks: Mitigation: Clear CPU buffers189gitlab # [ 0.566577] Spectre V2 : Mitigation: Enhanced / Automatic IBRS190gitlab # [ 0.567577] Speculative Return Stack Overflow: Mitigation: Safe RET191gitlab # [ 0.568577] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization192gitlab # [ 0.569586] Spectre V2 : Enabling IBPB for BPF193gitlab # [ 0.571579] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier194gitlab # [ 0.572578] active return thunk: srso_alias_return_thunk195gitlab # [ 0.574606] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'196gitlab # [ 0.575577] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'197gitlab # [ 0.577577] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'198gitlab # [ 0.578577] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'199gitlab # [ 0.579577] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'200gitlab # [ 0.580577] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'201gitlab # [ 0.581577] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'202gitlab # [ 0.582577] x86/fpu: Supporting XSAVE feature 0x800: 'Control-flow User registers'203gitlab # [ 0.583577] x86/fpu: Supporting XSAVE feature 0x1000: 'Control-flow Kernel registers (KVM only)'204gitlab # [ 0.585578] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256205gitlab # [ 0.586577] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64206gitlab # [ 0.587577] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512207gitlab # [ 0.588577] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024208gitlab # [ 0.590577] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8209gitlab # [ 0.591577] x86/fpu: xstate_offset[11]: 2440, xstate_sizes[11]: 16210gitlab # [ 0.592577] x86/fpu: xstate_offset[12]: 2456, xstate_sizes[12]: 24211gitlab # [ 0.593577] x86/fpu: Enabled xstate features 0x1ae7, context size is 2480 bytes, using 'compacted' format.212gitlab # [ 0.624609] Freeing SMP alternatives memory: 44K213gitlab # [ 0.625580] pid_max: default: 32768 minimum: 301214gitlab # [ 0.627614] LSM: initializing lsm=capability,landlock,yama,bpf,ima215gitlab # [ 0.629686] landlock: Up and running.216gitlab # [ 0.630577] Yama: becoming mindful.217gitlab # [ 0.631789] LSM support for eBPF active218gitlab # [ 0.633823] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)219gitlab # [ 0.634728] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)220gitlab # [ 0.637882] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)221gitlab # [ 0.639223] Performance Events: Fam17h+ core perfctr, AMD PMU driver.222gitlab # [ 0.639587] ... version: 2223gitlab # [ 0.640579] ... bit width: 48224gitlab # [ 0.641579] ... generic counters: 6225gitlab # [ 0.642579] ... generic bitmap: 000000000000003f226gitlab # [ 0.643579] ... fixed-purpose counters: 0227gitlab # [ 0.644578] ... fixed-purpose bitmap: 0000000000000000228gitlab # [ 0.645578] ... value mask: 0000ffffffffffff229gitlab # [ 0.646578] ... max period: 00007fffffffffff230gitlab # [ 0.647579] ... global_ctrl mask: 000000000000003f231gitlab # [ 0.648692] signal: max sigframe size: 3376232gitlab # [ 0.649676] rcu: Hierarchical SRCU implementation.233gitlab # [ 0.650583] rcu: Max phase no-delay instances is 400.234gitlab # [ 0.651784] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level235gitlab # [ 0.657230] smp: Bringing up secondary CPUs ...236gitlab # [ 0.657984] smpboot: x86: Booting SMP configuration:237gitlab # [ 0.658589] .... node #0, CPUs: #1 #2 #3238gitlab # [ 0.662727] smp: Brought up 1 node, 4 CPUs239gitlab # [ 0.664579] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)240gitlab # [ 0.666249] Memory: 6011588K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved)241gitlab # [ 0.668577] devtmpfs: initialized242gitlab # [ 0.669814] x86/mm: Memory block size: 128MB243gitlab # [ 0.672759] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)244gitlab # [ 0.674673] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).245gitlab # [ 0.675680] pinctrl core: initialized pinctrl subsystem246gitlab # [ 0.676928] PM: RTC time: 10:46:43, date: 2026-08-11247gitlab # [ 0.680594] NET: Registered PF_NETLINK/PF_ROUTE protocol family248gitlab # [ 0.683452] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations249gitlab # [ 0.684648] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations250gitlab # [ 0.686713] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations251gitlab # [ 0.687591] audit: initializing netlink subsys (disabled)252gitlab # [ 0.688765] audit: type=2000 audit(1786445202.958:1): state=initialized audit_enabled=0 res=1253gitlab # [ 0.688847] thermal_sys: Registered thermal governor 'fair_share'254gitlab # [ 0.690579] thermal_sys: Registered thermal governor 'bang_bang'255gitlab # [ 0.691579] thermal_sys: Registered thermal governor 'step_wise'256gitlab # [ 0.692579] thermal_sys: Registered thermal governor 'user_space'257gitlab # [ 0.693579] thermal_sys: Registered thermal governor 'power_allocator'258gitlab # [ 0.694605] cpuidle: using governor menu259gitlab # [ 0.697811] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5260gitlab # [ 0.698900] PCI: Using configuration type 1 for base access261gitlab # [ 0.699579] PCI: Using configuration type 1 for extended access262gitlab # [ 0.700736] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.263gitlab # [ 0.702990] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages264gitlab # [ 0.704579] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page265gitlab # [ 0.705579] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages266gitlab # [ 0.706579] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page267gitlab # [ 0.711714] ACPI: Added _OSI(Module Device)268gitlab # [ 0.715589] ACPI: Added _OSI(Processor Device)269gitlab # [ 0.718588] ACPI: Added _OSI(Processor Aggregator Device)270gitlab # [ 0.727622] ACPI: 1 ACPI AML tables successfully acquired and loaded271gitlab # [ 0.737542] ACPI: Interpreter enabled272gitlab # [ 0.740873] ACPI: PM: (supports S0 S3 S4 S5)273gitlab # [ 0.744590] ACPI: Using IOAPIC for interrupt routing274gitlab # [ 0.748004] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug275gitlab # [ 0.754587] PCI: Using E820 reservations for host bridge windows276gitlab # [ 0.759368] ACPI: Enabled 2 GPEs in block 00 to 0F277gitlab # [ 0.775111] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])278gitlab # [ 0.778594] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]279gitlab # [ 0.784769] acpiphp: Slot [3] registered280gitlab # [ 0.786666] acpiphp: Slot [4] registered281gitlab # [ 0.789664] acpiphp: Slot [5] registered282gitlab # [ 0.791636] acpiphp: Slot [6] registered283gitlab # [ 0.792619] acpiphp: Slot [7] registered284gitlab # [ 0.794623] acpiphp: Slot [8] registered285gitlab # [ 0.795619] acpiphp: Slot [9] registered286gitlab # [ 0.796632] acpiphp: Slot [10] registered287gitlab # [ 0.797622] acpiphp: Slot [11] registered288gitlab # [ 0.799622] acpiphp: Slot [12] registered289gitlab # [ 0.800652] acpiphp: Slot [13] registered290gitlab # [ 0.801618] acpiphp: Slot [14] registered291gitlab # [ 0.802612] acpiphp: Slot [15] registered292gitlab # [ 0.804692] acpiphp: Slot [16] registered293gitlab # [ 0.805758] acpiphp: Slot [17] registered294gitlab # [ 0.808675] acpiphp: Slot [18] registered295gitlab # [ 0.812669] acpiphp: Slot [19] registered296gitlab # [ 0.815721] acpiphp: Slot [20] registered297gitlab # [ 0.818668] acpiphp: Slot [21] registered298gitlab # [ 0.821669] acpiphp: Slot [22] registered299gitlab # [ 0.824667] acpiphp: Slot [23] registered300gitlab # [ 0.828767] acpiphp: Slot [24] registered301gitlab # [ 0.831672] acpiphp: Slot [25] registered302gitlab # [ 0.834668] acpiphp: Slot [26] registered303gitlab # [ 0.837667] acpiphp: Slot [27] registered304gitlab # [ 0.840702] acpiphp: Slot [28] registered305gitlab # [ 0.844687] acpiphp: Slot [29] registered306gitlab # [ 0.847728] acpiphp: Slot [30] registered307gitlab # [ 0.850680] acpiphp: Slot [31] registered308gitlab # [ 0.852723] PCI host bridge to bus 0000:00309gitlab # [ 0.855625] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]310gitlab # [ 0.859586] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]311gitlab # [ 0.863586] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]312gitlab # [ 0.867585] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]313gitlab # [ 0.869580] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]314gitlab # [ 0.871594] pci_bus 0000:00: root bus resource [bus 00-ff]315gitlab # [ 0.876858] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint316gitlab # [ 0.886023] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint317gitlab # [ 0.893925] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint318gitlab # [ 0.905757] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]319gitlab # [ 0.909748] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk320gitlab # [ 0.914588] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk321gitlab # [ 0.918588] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk322gitlab # [ 0.924589] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk323gitlab # [ 0.928198] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint324gitlab # [ 0.935716] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]325gitlab # [ 0.941129] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint326gitlab # [ 0.944236] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI327gitlab # [ 0.945594] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB328gitlab # [ 0.948009] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint329gitlab # [ 0.958689] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]330gitlab # [ 0.960610] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]331gitlab # [ 0.962652] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]332gitlab # [ 0.964014] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]333gitlab # [ 0.979586] pci 0000:00:02.0: pci_fixup_video+0x0/0x100 took 14648 usecs334gitlab # [ 0.981735] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint335gitlab # [ 0.988616] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]336gitlab # [ 0.989594] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]337gitlab # [ 0.991631] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]338gitlab # [ 0.993594] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]339gitlab # [ 0.998948] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint340gitlab # [ 1.004613] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]341gitlab # [ 1.006648] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]342gitlab # [ 1.008639] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]343gitlab # [ 1.013052] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint344gitlab # [ 1.019613] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]345gitlab # [ 1.020594] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]346gitlab # [ 1.022632] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]347gitlab # [ 1.026633] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint348gitlab # [ 1.032652] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]349gitlab # [ 1.034594] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]350gitlab # [ 1.035632] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]351gitlab # [ 1.040605] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint352gitlab # [ 1.045615] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]353gitlab # [ 1.047594] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]354gitlab # [ 1.049634] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]355gitlab # [ 1.053606] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint356gitlab # [ 1.058615] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]357gitlab # [ 1.060595] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]358gitlab # [ 1.062654] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]359gitlab # [ 1.066746] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint360gitlab # [ 1.071614] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]361gitlab # [ 1.073597] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]362gitlab # [ 1.074631] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]363gitlab # [ 1.077645] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]364gitlab # [ 1.082438] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint365gitlab # [ 1.087628] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]366gitlab # [ 1.088631] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]367gitlab # [ 1.093579] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint368gitlab # [ 1.099624] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]369gitlab # [ 1.101594] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]370gitlab # [ 1.103632] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]371gitlab # [ 1.107593] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint372gitlab # [ 1.112888] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]373gitlab # [ 1.114594] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]374gitlab # [ 1.116632] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]375gitlab # [ 1.126173] ACPI: PCI: Interrupt link LNKA configured for IRQ 10376gitlab # [ 1.127828] ACPI: PCI: Interrupt link LNKB configured for IRQ 10377gitlab # [ 1.129777] ACPI: PCI: Interrupt link LNKC configured for IRQ 11378gitlab # [ 1.131776] ACPI: PCI: Interrupt link LNKD configured for IRQ 11379gitlab # [ 1.133712] ACPI: PCI: Interrupt link LNKS configured for IRQ 9380gitlab # [ 1.137862] iommu: Default domain type: Translated381gitlab # [ 1.138582] iommu: DMA domain TLB invalidation policy: lazy mode382gitlab # [ 1.141920] ACPI: bus type USB registered383gitlab # [ 1.142766] usbcore: registered new interface driver usbfs384gitlab # [ 1.144607] usbcore: registered new interface driver hub385gitlab # [ 1.146645] usbcore: registered new device driver usb386gitlab # [ 1.149337] NetLabel: Initializing387gitlab # [ 1.150387] NetLabel: domain hash size = 128388gitlab # [ 1.151579] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO389gitlab # [ 1.153723] NetLabel: unlabeled traffic allowed by default390gitlab # [ 1.155593] PCI: Using ACPI for IRQ routing391gitlab # [ 1.157714] pci 0000:00:02.0: vgaarb: setting as boot VGA device392gitlab # [ 1.158574] pci 0000:00:02.0: vgaarb: bridge control possible393gitlab # [ 1.158574] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none394gitlab # [ 1.163583] vgaarb: loaded395gitlab # [ 1.164799] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0396gitlab # [ 1.165579] hpet0: 3 comparators, 64-bit 100.000000 MHz counter397gitlab # [ 1.170758] clocksource: Switched to clocksource kvm-clock398gitlab # [ 1.176547] VFS: Disk quotas dquot_6.6.0399gitlab # [ 1.177889] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)400gitlab # [ 1.180237] pnp: PnP ACPI init401gitlab # [ 1.181961] pnp: PnP ACPI: found 6 devices402gitlab # [ 1.192107] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns403gitlab # [ 1.194853] clocksource: Switched to clocksource acpi_pm404gitlab # [ 1.196619] NET: Registered PF_INET protocol family405gitlab # [ 1.199621] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)406gitlab # [ 1.230133] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)407gitlab # [ 1.232783] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)408gitlab # [ 1.235282] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)409gitlab # [ 1.242828] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)410gitlab # [ 1.245095] TCP: Hash tables configured (established 65536 bind 65536)411gitlab # [ 1.247637] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)412gitlab # [ 1.250271] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)413gitlab # [ 1.252602] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)414gitlab # [ 1.254947] NET: Registered PF_UNIX/PF_LOCAL protocol family415gitlab # [ 1.256778] NET: Registered PF_XDP protocol family416gitlab # [ 1.258318] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]417gitlab # [ 1.260158] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]418gitlab # [ 1.261981] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]419gitlab # [ 1.264013] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]420gitlab # [ 1.266010] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]421gitlab # [ 1.268393] pci 0000:00:01.0: PIIX3: Enabling Passive Release422gitlab # [ 1.270171] pci 0000:00:00.0: Limiting direct PCI/PCI transfers423gitlab # [ 1.273501] ACPI: \_SB_.LNKD: Enabled at IRQ 11424gitlab # [ 1.277046] PCI: CLS 0 bytes, default 64425gitlab # [ 1.278443] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)426gitlab # [ 1.278846] Trying to unpack rootfs image as initramfs...427gitlab # [ 1.280406] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)428gitlab # [ 1.284616] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns429gitlab # [ 1.307307] Initialise system trusted keyrings430gitlab # [ 1.309230] workingset: timestamp_bits=40 max_order=21 bucket_order=0431gitlab # [ 1.324246] Key type asymmetric registered432gitlab # [ 1.327642] Asymmetric key parser 'x509' registered433gitlab # [ 1.331866] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)434gitlab # [ 1.338011] io scheduler mq-deadline registered435gitlab # [ 1.341577] io scheduler kyber registered436gitlab # [ 1.349436] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled437gitlab # [ 1.352195] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A438gitlab # [ 1.356709] Linux agpgart interface v0.103439gitlab # [ 1.358354] ACPI: bus type drm_connector registered440gitlab # [ 1.362404] usbcore: registered new interface driver usbserial_generic441gitlab # [ 1.364716] usbserial: USB Serial support registered for generic442gitlab # [ 1.366827] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.443gitlab # [ 1.366827] Please enable it if your BIOS has the CPPC option.444gitlab # [ 1.371377] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled445gitlab # [ 1.375024] drop_monitor: Initializing network drop monitor service446gitlab # [ 1.377184] NET: Registered PF_INET6 protocol family447gitlab # [ 1.380230] Segment Routing with IPv6448gitlab # [ 1.381564] In-situ OAM (IOAM) with IPv6449gitlab # [ 1.385227] IPI shorthand broadcast: enabled450gitlab # [ 1.393057] sched_clock: Marking stable (1126074725, 266733748)->(1468418513, -75610040)451gitlab # [ 1.400248] registered taskstats version 1452gitlab # [ 1.404289] Loading compiled-in X.509 certificates453gitlab # [ 1.421778] Demotion targets for Node 0: null454gitlab # [ 1.423551] Key type .fscrypt registered455gitlab # [ 1.424825] Key type fscrypt-provisioning registered456gitlab # [ 1.426497] ima: No TPM chip found, activating TPM-bypass!457gitlab # [ 1.428193] ima: Allocated hash algorithm: sha1458gitlab # [ 1.429654] ima: No architecture policies found459gitlab # [ 1.431465] PM: Magic number: 6:135:780460gitlab # [ 1.433772] RAS: Correctable Errors collector initialized.461gitlab # [ 1.439067] clk: Disabling unused clocks462gitlab # [ 1.440333] PM: genpd: Disabling unused power domains463gitlab # [ 1.565339] Freeing initrd memory: 29392K464gitlab # [ 1.572537] Freeing unused decrypted memory: 2028K465gitlab # [ 1.581216] Freeing unused kernel image (initmem) memory: 3640K466gitlab # [ 1.585940] Write protecting the kernel read-only data: 32768k467gitlab # [ 1.593034] Freeing unused kernel image (text/rodata gap) memory: 1220K468gitlab # [ 1.599190] Freeing unused kernel image (rodata/data gap) memory: 760K469gitlab # [ 1.664544] x86/mm: Checked W+X mappings: passed, no W+X pages found.470gitlab # [ 1.666559] Run /init as init process471gitlab # [ 1.681412] systemd[1]: Inserted module 'autofs4'472gitlab # [ 1.710323] fuse: init (API version 7.45)473gitlab # [ 1.720543] ACPI: \_SB_.LNKC: Enabled at IRQ 10474gitlab # [ 1.729800] ACPI: \_SB_.LNKA: Enabled at IRQ 10475gitlab # [ 1.746579] ACPI: \_SB_.LNKB: Enabled at IRQ 11476gitlab # [ 1.797792] systemd[1]: Successfully made /usr/ read-only.477gitlab # [ 2.137724] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)478gitlab # [ 2.159347] systemd[1]: Detected virtualization kvm.479gitlab # [ 2.163308] systemd[1]: Detected architecture x86-64.480gitlab # [ 2.167280] systemd[1]: Running in initrd.481gitlab # [ 2.171405] systemd[1]: Initializing machine ID from random generator.482gitlab # [ 2.176573] systemd[1]: Hostname set to <gitlab>.483gitlab # [ 2.292787] systemd[1]: bpf-restrict-fs: LSM BPF program attached484gitlab # [ 2.359801] systemd[1]: Queued start job for default target Initrd Default Target.485gitlab # [ 2.375921] systemd[1]: Created slice Slice /system/modprobe.486gitlab # [ 2.378331] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.487gitlab # [ 2.382541] systemd[1]: Expecting device /dev/disk/by-label/nix-store...488gitlab # [ 2.384621] systemd[1]: Expecting device /dev/disk/by-label/nixos...489gitlab # [ 2.386623] systemd[1]: Reached target Path Units.490gitlab # [ 2.388248] systemd[1]: Reached target Slice Units.491gitlab # [ 2.389855] systemd[1]: Reached target Swaps.492gitlab # [ 2.391317] systemd[1]: Reached target Timer Units.493gitlab # [ 2.393025] systemd[1]: Listening on D-Bus System Message Bus Socket.494gitlab # [ 2.395144] systemd[1]: Listening on Journal Socket (/dev/log).495gitlab # [ 2.397138] systemd[1]: Listening on Journal Sockets.496gitlab # [ 2.398979] systemd[1]: Listening on udev Control Socket.497gitlab # [ 2.400846] systemd[1]: Listening on udev Kernel Socket.498gitlab # [ 2.402538] systemd[1]: Reached target Socket Units.499gitlab # [ 2.405607] systemd[1]: Starting Create List of Static Device Nodes...500gitlab # [ 2.409054] systemd[1]: Starting Load Kernel Module 9pnet_virtio...501gitlab # [ 2.412134] systemd[1]: Starting Load Kernel Module configfs...502gitlab # [ 2.426003] systemd[1]: Starting Journal Service...503gitlab # [ 2.430870] systemd[1]: Starting Load Kernel Modules...504gitlab # [ 2.432550] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os505gitlab # [ 2.438857] systemd[1]: Starting Coldplug All udev Devices...506gitlab # [ 2.448182] systemd[1]: Finished Create List of Static Device Nodes.507gitlab # [ 2.456142] systemd[1]: modprobe@configfs.service: Deactivated successfully.508gitlab # [ 2.463942] systemd[1]: Finished Load Kernel Module configfs.509gitlab # [ 2.475550] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config510gitlab # [ 2.488979] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...511gitlab # [ 2.493269] netfs: FS-Cache loaded512gitlab # [ 2.495827] systemd-journald[91]: Collecting audit messages is disabled.513gitlab # [ 2.499847] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.514gitlab # [ 2.503908] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev515gitlab # [ 2.512717] 9pnet: Installing 9P2000 support516gitlab # [ 2.513868] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.517gitlab # [ 2.517700] systemd[1]: Finished Load Kernel Modules.518gitlab # [ 2.521051] systemd[1]: Starting Apply Kernel Variables...519gitlab # [ 2.523947] systemd[1]: Starting Create Static Device Nodes in /dev...520gitlab # [ 2.526383] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.521gitlab # [ 2.546297] systemd[1]: Finished Load Kernel Module 9pnet_virtio.522gitlab # [ 2.554071] systemd[1]: Finished Apply Kernel Variables.523gitlab # [ 2.556871] systemd[1]: Finished Create Static Device Nodes in /dev.524gitlab # [ 2.559302] systemd[1]: Reached target Preparation for Local File Systems.525gitlab # [ 2.561491] systemd[1]: Reached target Local File Systems.526gitlab # [ 2.564489] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 2.299177] systemd-modules-l[ 2.567134] systemd[1]: Started Journal Service.528gitlab # oad[92]: Using 4 probe threads529gitlab # [ 2.303283] systemd-modules-load[92]: Inserted module 'virtio_gpu'530gitlab # [ 2.305052] systemd-modules-load[92]: Inserted module 'dm_mod'531gitlab # [ 2.306723] systemd-modules-load[92]: Inserted module 'virtio_balloon'532gitlab # [ 2.310130] systemd[1]: Starting Create System Files and Directories...533gitlab # [ 2.320325] systemd[1]: Finished Create System Files and Directories.534gitlab # [ 2.327233] systemd-udevd[104]: Using default interface naming scheme 'v261'.535gitlab # [ 2.336545] systemd[1]: Finished Coldplug All udev Devices.536gitlab # [ 2.343732] systemd[1]: Started Rule-based Manager for Device Events and Files.537gitlab # [ 2.345399] systemd[1]: Reached target System Initialization.538gitlab # [ 2.346785] systemd[1]: Reached target Basic System.539gitlab # [ 2.761657] virtio_blk virtio4: 4/0/0 default/read/poll queues540gitlab # [ 2.765359] SCSI subsystem initialized541gitlab # [ 2.769340] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)542gitlab # [ 2.777308] virtio_blk virtio5: 4/0/0 default/read/poll queues543gitlab # [ 2.781959] virtio_blk virtio5: [vdb] 11784496 512-byte logical blocks (6.03 GB/5.62 GiB)544gitlab # [ 2.788572] uhci_hcd 0000:00:01.2: UHCI Host Controller545gitlab # [ 2.792365] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1546gitlab # [ 2.795342] uhci_hcd 0000:00:01.2: detected 2 ports547gitlab # [ 2.797352] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140548gitlab # [ 2.799712] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18549gitlab # [ 2.801765] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1550gitlab # [ 2.805806] usb usb1: Product: UHCI Host Controller551gitlab # [ 2.808255] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd552gitlab # [ 2.810354] usb usb1: SerialNumber: 0000:00:01.2553gitlab # [ 2.817157] hub 1-0:1.0: USB hub found554gitlab # [ 2.818170] hub 1-0:1.0: 2 ports detected555gitlab # [ 2.825921] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12556gitlab # [ 2.828977] serio: i8042 KBD port at 0x60,0x64 irq 1557gitlab # [ 2.830207] serio: i8042 AUX port at 0x60,0x64 irq 12558gitlab # [ 2.848119] scsi host0: ata_piix559gitlab # [ 2.584189] (udev-worker)[127]: Network interface NamePolicy= disabled on kernel command line.560gitlab # [ 2.592226] (udev-worker)[137]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface[ 2.861697] scsi host1: ata_piix561gitlab # name.562gitlab # [ 2.863302] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0563gitlab # [ 2.596989] (udev-worker)[137]: Network interface NamePolicy= disabled on ker[ 2.866062] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0564gitlab # nel command line.565gitlab # [ 2.602461] systemd[1]: Starting Virtual Console Setup...566gitlab # [ 2.613768] systemd[1]: Found device /dev/disk/by-label/nix-store.567gitlab # [ 2.618454] systemd[1]: Found device /dev/disk/by-label/nixos.568gitlab # [ 2.620847] systemd[1]: Reached target Initrd Root Device.569gitlab # [ 2.622204] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...570gitlab # [ 2.624883] systemd-vconsole-setup[146]: Configuration of first virtual console was skipped, ignoring remaining ones.571gitlab # [ 2.636840] systemd[1]: Finished Virtual Console Setup.572gitlab # [ 2.653094] systemd-fsck[156]: nixos: clean, 12/65536 files, 13019/262144 blocks573gitlab # [ 2.657403] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.574gitlab # [ 3.031531] ata2: found unknown device (class 0)575gitlab # [ 3.036821] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100576gitlab # [ 3.044157] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5577gitlab # [ 3.049096] usb 1-1: new full-speed USB device number 2 using uhci_hcd578gitlab # [ 3.080390] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0579gitlab # [ 3.122168] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray580gitlab # [ 3.157136] cdrom: Uniform CD-ROM driver Revision: 3.20581gitlab # [ 3.221995] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00582gitlab # [ 3.226874] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10583gitlab # [ 3.231589] usb 1-1: Product: QEMU USB Tablet584gitlab # [ 3.234600] usb 1-1: Manufacturer: QEMU585gitlab # [ 3.237185] usb 1-1: SerialNumber: 28754-0000:00:01.2-1586gitlab # [ 3.279129] hid: raw HID events driver (C) Jiri Kosina587gitlab # [ 3.292975] usbcore: registered new interface driver usbhid588gitlab # [ 3.295964] usbhid: USB HID core driver589gitlab # [ 3.307105] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2590gitlab # [ 3.312490] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0591gitlab # [ 3.184437] systemd[1]: Mounting /sysroot...592gitlab # [ 3.627102] EXT4-fs (vda): mounted filesystem 2dac2cb1-e69b-4300-900b-8f7c8f0ca27e r/w with ordered data mode. Quota mode: none.593gitlab # [ 3.364876] systemd[1]: Mounted /sysroot.594gitlab # [ 3.366293] systemd[1]: Reached target Initrd Root File System.595gitlab # [ 3.368448] systemd[1]: Mounting /sysroot/nix/.ro-store...596gitlab # [ 3.370313] systemd[1]: Mounting /sysroot/nix/.rw-store...597gitlab # [ 3.372230] systemd[1]: Mounting /sysroot/run...598gitlab # [ 3.374487] systemd[1]: Mounting /sysroot/tmp/shared...599gitlab # [ 3.380983] systemd[1]: Mounting /sysroot/tmp/xchg...600gitlab # [ 3.383234] systemd[1]: Starting Mountpoints Configured in the Real Root...601gitlab # [ 3.657987] 9p: Installing v9fs 9p2000 file system support602gitlab # [ 3.391580] systemd[1]: Mounted /sysroot/nix/.rw-store.603gitlab # [ 3.394222] systemd-sysroot-fstab-check[178]: /sysroot should be mounted in the initrd, will request daemon-reload.604gitlab # [ 3.397951] systemd[1]: Mounted /sysroot/run.605gitlab # [ 3.400418] systemd[1]: Mounted /sysroot/tmp/shared.606gitlab # [ 3.666796] erofs (device vdb): mounted with root inode @ nid 128.607gitlab # [ 3.403426] systemd[1]: Mounted /sysroot/tmp/xchg.608gitlab # [ 3.404808] systemd[1]: Mounted /sysroot/nix/.ro-store.609gitlab # [ 3.406104] systemd[1]: Reload requested from client PID 178 ('systemd-sysroot') (unit initrd-parse-etc.service)...610gitlab # [ 3.408688] systemd[1]: Reloading...611gitlab # [ 3.470936] systemd[1]: Reloading finished in 64 ms.612gitlab # [ 3.500667] systemd-sysroot-fstab-check[178]: Requesting initrd-fs.target/start/replace...613gitlab # [ 3.505596] systemd-sysroot-fstab-check[178]: Requesting swap.target/start/replace...614gitlab # [ 3.510317] systemd[1]: Starting rw-sysroot-nix-store.service...615gitlab # [ 3.513878] systemd[1]: initrd-parse-etc.service: Deactivated successfully.616gitlab # [ 3.518116] systemd[1]: Finished Mountpoints Configured in the Real Root.617gitlab # [ 3.522266] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.618gitlab # [ 3.530912] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.619gitlab # [ 3.535268] systemd[1]: Finished rw-sysroot-nix-store.service.620gitlab # [ 4.185349] systemd[1]: Mounting /sysroot/nix/store...621gitlab # [ 4.239722] systemd[1]: Mounted /sysroot/nix/store.622gitlab # [ 4.242936] systemd[1]: Reached target Initrd File Systems.623gitlab # [ 4.246491] systemd[1]: Starting Find NixOS closure...624gitlab # [ 4.249811] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...625gitlab # [ 4.281811] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.626gitlab # [ 4.286828] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.627gitlab # [ 4.299764] systemd[1]: Finished Find NixOS closure.628gitlab # [ 4.303440] systemd[1]: Reached target Initrd Default Target.629gitlab # [ 4.306880] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...630gitlab # [ 4.344256] systemd[1]: Stopped target Initrd Default Target.631gitlab # [ 4.347799] systemd[1]: Stopped target Basic System.632gitlab # [ 4.351110] systemd[1]: Stopped target Initrd Root Device.633gitlab # [ 4.354439] systemd[1]: Stopped target Path Units.634gitlab # [ 4.357553] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.635gitlab # [ 4.361892] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.636gitlab # [ 4.366824] systemd[1]: Stopped target Slice Units.637gitlab # [ 4.370937] systemd[1]: Stopped target Socket Units.638gitlab # [ 4.375942] systemd[1]: Stopped target System Initialization.639gitlab # [ 4.379594] systemd[1]: Stopped target Swaps.640gitlab # [ 4.381961] systemd[1]: Stopped target Timer Units.641gitlab # [ 4.384509] systemd[1]: dbus.socket: Deactivated successfully.642gitlab # [ 4.387454] systemd[1]: Closed D-Bus System Message Bus Socket.643gitlab # [ 4.390682] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.644gitlab # [ 4.394363] systemd[1]: Stopped Find NixOS closure.645gitlab # [ 4.396714] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio646gitlab # [ 4.401312] systemd[1]: Starting rw-sysroot-nix-store.service...647gitlab # [ 4.403386] systemd[1]: systemd-sysctl.service: Deactivated successfully.648gitlab # [ 4.405070] systemd[1]: Stopped Apply Kernel Variables.649gitlab # [ 4.406362] systemd[1]: systemd-modules-load.service: Deactivated successfully.650gitlab # [ 4.408048] systemd[1]: Stopped Load Kernel Modules.651gitlab # [ 4.409321] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.652gitlab # [ 4.411152] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.653gitlab # [ 4.412951] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.654gitlab # [ 4.414678] systemd[1]: Stopped Create System Files and Directories.655gitlab # [ 4.416173] systemd[1]: Stopped target Local File Systems.656gitlab # [ 4.417486] systemd[1]: Stopped target Preparation for Local File Systems.657gitlab # [ 4.419083] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.658gitlab # [ 4.420769] systemd[1]: Stopped Coldplug All udev Devices.659gitlab # [ 4.422149] systemd[1]: Stopping Rule-based Manager for Device Events and Files...660gitlab # [ 4.424109] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.661gitlab # [ 4.425797] systemd[1]: Stopped Virtual Console Setup.662gitlab # [ 4.427059] systemd[1]: initrd-cleanup.service: Deactivated successfully.663gitlab # [ 4.428618] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.664gitlab # [ 4.430165] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.665gitlab # [ 4.431851] systemd[1]: Finished rw-sysroot-nix-store.service.666gitlab # [ 4.433307] systemd[1]: systemd-udevd.service: Deactivated successfully.667gitlab # [ 4.434826] systemd[1]: Stopped Rule-based Manager for Device Events and Files.668gitlab # [ 4.436550] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.669gitlab # [ 4.438221] systemd[1]: Closed udev Control Socket.670gitlab # [ 4.439406] systemd[1]: Starting Cleanup udev Database...671gitlab # [ 4.440687] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.672gitlab # [ 4.442452] systemd[1]: Stopped Create Static Device Nodes in /dev.673gitlab # [ 4.443916] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.674gitlab # [ 4.445784] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.675gitlab # [ 4.447414] systemd[1]: kmod-static-nodes.service: Deactivated successfully.676gitlab # [ 4.449042] systemd[1]: Stopped Create List of Static Device Nodes.677gitlab # [ 4.450525] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.678gitlab # [ 4.452272] systemd[1]: Finished Cleanup udev Database.679gitlab # [ 4.453522] systemd[1]: Reached target Switch Root.680gitlab # [ 4.454780] systemd[1]: Starting NixOS Activation...681gitlab # [ 4.535917] initrd-nixos-activation-start[223]: booting system configuration /nix/store/rqh61wnlw88qw9fgsnz3g7c157g8vjp1-nixos-system-gitlab-test682gitlab # [ 4.574811] initrd-nixos-activation-start[223]: running activation script...683gitlab # [ 4.808702] initrd-nixos-activation-start[246]: setting up /etc...684gitlab # [ 4.927772] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.685gitlab # [ 4.930406] systemd[1]: Finished NixOS Activation.686gitlab # [ 4.933135] systemd[1]: Starting Switch Root...687gitlab # [ 4.956899] systemd[1]: Switching root.688gitlab # [ 5.295011] systemd-journald[91]: Received SIGTERM from PID 1 (systemd).689gitlab # [ 5.410584] NET: Registered PF_VSOCK protocol family690gitlab # [ 5.794564] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)691gitlab # [ 5.811045] systemd[1]: Detected virtualization kvm.692gitlab # [ 5.814266] systemd[1]: Detected architecture x86-64.693gitlab # [ 5.817575] systemd[1]: Detected first boot.694gitlab # [ 5.821479] systemd[1]: Initializing machine ID from random generator.695gitlab # [ 5.978826] systemd[1]: bpf-restrict-fs: LSM BPF program attached696gitlab # [ 6.080364] systemd[1]: Applying preset policy.697gitlab # [ 6.227996] systemd[1]: Populated /etc with preset unit settings.698gitlab # [ 6.361457] systemd[1]: initrd-switch-root.service: Deactivated successfully.699gitlab # [ 6.363830] systemd[1]: Stopped initrd-switch-root.service.700gitlab # [ 6.367302] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.701gitlab # [ 6.370500] systemd[1]: Created slice Slice /system/getty.702gitlab # [ 6.372679] systemd[1]: Created slice GitLab DevOps Platform Slice.703gitlab # [ 6.374949] systemd[1]: Created slice User and Session Slice.704gitlab # [ 6.376542] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.705gitlab # [ 6.378592] systemd[1]: Started Forward Password Requests to Wall Directory Watch.706gitlab # [ 6.380497] systemd[1]: Expecting device /dev/hvc0...707gitlab # [ 6.381779] systemd[1]: Expecting device /dev/ttyS0...708gitlab # [ 6.383103] systemd[1]: Reached target Local Encrypted Volumes.709gitlab # [ 6.384598] systemd[1]: Stopped target initrd-fs.target.710gitlab # [ 6.385965] systemd[1]: Stopped target initrd-root-fs.target.711gitlab # [ 6.387408] systemd[1]: Stopped target initrd-switch-root.target.712gitlab # [ 6.388989] systemd[1]: Reached target Virtual Machines and Containers.713gitlab # [ 6.390659] systemd[1]: Reached target Path Units.714gitlab # [ 6.391997] systemd[1]: Reached target Remote File Systems.715gitlab # [ 6.393415] systemd[1]: Reached target Slice Units.716gitlab # [ 6.394711] systemd[1]: Reached target Swaps.717gitlab # [ 6.396892] systemd[1]: Listening on Query the User Interactively for a Password.718gitlab # [ 6.399678] systemd[1]: Listening on Process Core Dump Socket.719gitlab # [ 6.401857] systemd[1]: Listening on Credential Encryption/Decryption.720gitlab # [ 6.404215] systemd[1]: Listening on Factory Reset Management.721gitlab # [ 6.405849] systemd[1]: Listening on Hostname Service Socket.722gitlab # [ 6.409154] systemd[1]: Starting Journal Log Access Socket...723gitlab # [ 6.411374] systemd[1]: Listening on Journal Audit Socket.724gitlab # [ 6.414010] systemd[1]: Listening on Console Output Muting Service Socket.725gitlab # [ 6.416075] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.726gitlab # [ 6.417956] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os727gitlab # [ 6.420186] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki728gitlab # [ 6.423910] systemd[1]: Listening on Disk Repartitioning Service Socket.729gitlab # [ 6.425691] systemd[1]: Listening on udev Control Socket.730gitlab # [ 6.427254] systemd[1]: Listening on udev Varlink Socket.731gitlab # [ 6.431044] systemd[1]: Mounting Huge Pages File System...732gitlab # [ 6.447386] systemd[1]: Mounting POSIX Message Queue File System...733gitlab # [ 6.450416] systemd[1]: Mounting Kernel Debug File System...734gitlab # [ 6.453353] systemd[1]: Mounting Kernel Trace File System...735gitlab # [ 6.459139] systemd[1]: Starting Create List of Static Device Nodes...736gitlab # [ 6.463557] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio737gitlab # [ 6.476637] systemd[1]: Starting Load Kernel Module configfs...738gitlab # [ 6.480517] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm739gitlab # [ 6.486658] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore740gitlab # [ 6.493052] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse741gitlab # [ 6.501833] systemd[1]: Mounting FUSE Control File System...742gitlab # [ 6.504869] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67743gitlab # [ 6.520922] systemd[1]: Starting Journal Service...744gitlab # [ 6.526085] systemd[1]: Starting Load Kernel Modules...745gitlab # [ 6.529351] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...746gitlab # [ 6.534864] systemd[1]: Starting Remount Root and Kernel File Systems...747gitlab # [ 6.536606] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os748gitlab # [ 6.543854] systemd[1]: Starting Coldplug All udev Devices...749gitlab # [ 6.548092] systemd[1]: Listening on Journal Log Access Socket.750gitlab # [ 6.550245] systemd[1]: Mounted Huge Pages File System.751gitlab # [ 6.553500] systemd[1]: Mounted POSIX Message Queue File System.752gitlab # [ 6.555302] systemd[1]: Mounted Kernel Debug File System.753gitlab # [ 6.556936] EXT4-fs (vda): re-mounted 2dac2cb1-e69b-4300-900b-8f7c8f0ca27e.754gitlab # [ 6.557835] systemd[1]: Mounted Kernel Trace File System.755gitlab # [ 6.565144] systemd[1]: Finished Create List of Static Device Nodes.756gitlab # [ 6.567708] systemd-journald[318]: Collecting audit messages is enabled.757gitlab # [ 6.567898] systemd[1]: modprobe@configfs.service: Deactivated successfully.758gitlab # [ 6.567997] loop: module loaded759gitlab # [ 6.576416] systemd[1]: Finished Load Kernel Module configfs.760gitlab # [ 6.578328] systemd[1]: Mounted FUSE Control File System.761gitlab # [ 6.580596] systemd[1]: Finished Load Kernel Modules.762gitlab # [ 6.582852] systemd[1]: Finished Remount Root and Kernel File Systems.763gitlab # [ 6.585600] systemd[1]: Listening on Disk Image Download Service Socket.764gitlab # [ 6.589879] systemd[1]: Mounting Kernel Configuration File System...765gitlab # [ 6.323733] systemd[1]: Queued start job for default target Multi-User System.766gitlab # [ 6.326642] systemd[1]: Unnecessary job was removed for /dev/vdb.767gitlab # [ 6.328559] systemd[1]: systemd-journald.service: Deactivated successfully.768gitlab # [ 6.330540] systemd-modules-load[319]: Using 3 probe threads769gitlab # [ 6.332221] systemd-modules-load[319]: Inserted module 'tls'770gitlab # [ 6.333873] systemd-modules-load[319]: Inserted module 'loop'771gitlab # [ 6.601961] systemd[1]: Starting Firewall...772gitlab # [ 6.335701] systemd-oomd[320]: No swap; memory pressure usage will be degraded773gitlab # [ 6.605144] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore774gitlab # [ 6.616981] systemd[1]: Starting Load/Save OS Random Seed...775gitlab # [ 6.621848] systemd[1]: Starting Apply Kernel Variables...776gitlab # [ 6.625798] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...777gitlab # [ 6.627802] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os778gitlab # [ 6.631693] systemd[1]: Started Journal Service.779gitlab # [ 6.368915] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.780gitlab # [ 6.371447] systemd[1]: Mounted Kernel Configuration File System.781gitlab # [ 6.379133] systemd[1]: Finished Load/Save OS Random Seed.782gitlab # [ 6.384233] systemd[1]: Finished Apply Kernel Variables.783gitlab # [ 6.386826] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.784gitlab # [ 6.390149] systemd[1]: Reached target First Boot Complete.785gitlab # [ 6.393743] systemd[1]: Starting Flush Journal to Persistent Storage...786gitlab # [ 6.395428] systemd[1]: Starting Create Static Device Nodes in /dev...787gitlab # [ 6.678310] systemd-journald[318]: Received client request to flush runtime journal.788gitlab # [ 6.475103] systemd[1]: Finished Create Static Device Nodes in /dev.789gitlab # [ 6.477141] systemd[1]: Reached target Preparation for Local File Systems.790gitlab # [ 6.479290] systemd[1]: Starting Rule-based Manager for Device Events and Files...791gitlab # [ 6.481527] systemd-udevd[360]: Using default interface naming scheme 'v261'.792gitlab # [ 6.483309] systemd[1]: Finished Coldplug All udev Devices.793gitlab # [ 6.484725] systemd[1]: Finished Flush Journal to Persistent Storage.794gitlab # [ 6.488198] systemd[1]: Started Rule-based Manager for Device Events and Files.795gitlab # [ 6.611383] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse796gitlab # [ 6.628103] systemd[1]: Finished Firewall.797gitlab # [ 6.637422] (udev-worker)[426]: Network interface NamePolicy= disabled on kernel command line.798gitlab # [ 6.641357] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.799gitlab # [ 6.657366] (udev-worker)[442]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.800gitlab # [ 6.660899] (udev-worker)[442]: Network interface NamePolicy= disabled on kernel command line.801gitlab # [ 6.662911] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.802gitlab # [ 6.677362] systemd[1]: Condition check resulted in Virtio network device being skipped.803gitlab # [ 6.679310] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore804gitlab # [ 6.681951] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67805gitlab # [ 6.685625] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore806gitlab # [ 6.688241] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os807gitlab # [ 6.691981] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os808gitlab # [ 6.990756] mousedev: PS/2 mouse device common for all mice809gitlab # [ 7.002114] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3810gitlab # [ 7.009308] ACPI: button: Power Button [PWRF]811gitlab # [ 7.010511] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0812gitlab # [ 7.010594] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD813gitlab # [ 7.010602] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console814gitlab # [ 7.032295] Console: switching to colour dummy device 80x25815gitlab # [ 7.033517] [drm] Found bochs VGA, ID 0xb0c5.816gitlab # [ 7.033520] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.817gitlab # [ 7.038819] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic818gitlab # [ 7.041853] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0819gitlab # [ 7.044560] Floppy drive(s): fd0 is 2.88M AMI BIOS820gitlab # [ 7.056403] parport_pc 00:03: reported by Plug and Play ACPI821gitlab # [ 7.057794] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5822gitlab # [ 7.063596] FDC 0 is a S82078B823gitlab # [ 7.063801] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]824gitlab # [ 7.065090] Console: switching to colour frame buffer device 160x50825gitlab # [ 7.065252] rtc_cmos 00:05: RTC can wake from S4826gitlab # [ 7.065535] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4827gitlab # [ 7.073180] rtc_cmos 00:05: registered as rtc0828gitlab # [ 7.074414] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device829gitlab # [ 7.075317] rtc_cmos 00:05: setting system clock to 2026-08-11T10:46:49 UTC (1786445209)830gitlab # [ 7.078074] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs831gitlab # [ 7.150905] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6832gitlab # [ 6.890345] systemd[1]: Starting Virtual Console Setup...833gitlab # [ 7.186890] erofs (device vdb): failed to read inode meta block (nid: 127970395): -4834gitlab # [ 6.923293] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.835gitlab # [ 6.925276] systemd[1]: Stopped Virtual Console Setup.836gitlab # [ 6.930857] systemd[1]: Starting Virtual Console Setup...837gitlab # [ 7.201770] ppdev: user-space parallel port driver838gitlab # [ 6.947918] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.839gitlab # [ 6.950628] systemd[1]: Stopped Virtual Console Setup.840gitlab # [ 6.954487] systemd[1]: Starting Virtual Console Setup...841gitlab # [ 7.234504] kvm_amd: TSC scaling supported842gitlab # [ 7.235522] kvm_amd: Nested Virtualization enabled843gitlab # [ 7.236767] kvm_amd: Nested Paging enabled844gitlab # [ 7.237513] kvm_amd: LBR virtualization supported845gitlab # [ 7.238712] kvm_amd: Virtual VMLOAD VMSAVE supported846gitlab # [ 7.239953] kvm_amd: Virtual GIF supported847gitlab # [ 7.240881] kvm_amd: Virtual NMI enabled848gitlab # [ 7.290465] EDAC MC: Ver: 3.0.0849gitlab # [ 7.043405] systemd-vconsole-setup[494]: Configuration of first virtual console was skipped, ignoring remaining ones.850gitlab # [ 7.047534] systemd[1]: Finished Virtual Console Setup.851gitlab # [ 7.096708] systemd[1]: Mounting /run/wrappers...852gitlab # [ 7.120626] systemd[1]: Mounted /run/wrappers.853gitlab # [ 7.123600] systemd[1]: Reached target Local File Systems.854gitlab # [ 7.126966] systemd[1]: Listening on Boot Loader Control Service Socket.855gitlab # [ 7.130663] systemd[1]: Starting register-nix-paths.service...856gitlab # [ 7.133952] systemd[1]: Starting Create SUID/SGID Wrappers...857gitlab # [ 7.137279] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.858gitlab # [ 7.143358] systemd[1]: Starting Save Transient machine-id to Disk...859gitlab # [ 7.146254] systemd[1]: Starting Create System Files and Directories...860gitlab # [ 7.166097] systemd[1]: Finished Create System Files and Directories.861gitlab # [ 7.169045] systemd[1]: Starting Rebuild Journal Catalog...862gitlab # [ 7.174325] systemd[1]: Starting Record System Boot/Shutdown in UTMP...863gitlab # [ 7.189137] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.864gitlab # [ 7.191986] systemd[1]: Finished Save Transient machine-id to Disk.865gitlab # [ 7.195061] systemd[1]: Finished Record System Boot/Shutdown in UTMP.866gitlab # [ 7.211404] systemd[1]: Finished Rebuild Journal Catalog.867gitlab # [ 7.214503] systemd[1]: Starting Update is Completed...868gitlab # [ 7.237134] systemd[1]: Finished Update is Completed.869gitlab # [ 7.270199] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.870gitlab # [ 7.272088] systemd[1]: Finished Create SUID/SGID Wrappers.871gitlab # [ 7.509291] systemd[1]: Finished register-nix-paths.service.872gitlab # [ 7.510841] systemd[1]: Reached target System Initialization.873gitlab # [ 7.512277] systemd[1]: Started Discard unused filesystem blocks once a week.874gitlab # [ 7.513967] systemd[1]: Started logrotate.timer.875gitlab # [ 7.515206] systemd[1]: Started Daily Cleanup of Temporary Directories.876gitlab # [ 7.516816] systemd[1]: Reached target Timer Units.877gitlab # [ 7.518095] systemd[1]: Listening on D-Bus System Message Bus Socket.878gitlab # [ 7.519660] systemd[1]: Listening on Nix Daemon Socket.879gitlab # [ 7.525289] systemd[1]: Starting nixbot CI service socket...880gitlab # [ 7.526713] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.881gitlab # [ 7.533486] systemd[1]: Starting D-Bus System Message Bus...882gitlab # [ 7.534903] systemd[1]: Listening on nixbot CI service socket.883gitlab # [ 7.536329] systemd[1]: Reached target Socket Units.884gitlab # [ 7.594323] dbus-broker-launch[576]: Looking up NSS user entry for 'systemd-timesync'...885gitlab # [ 7.599743] dbus-broker-launch[576]: NSS returned no entry for 'systemd-timesync'886gitlab # [ 7.603944] dbus-broker-launch[576]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"887gitlab # [ 7.613505] systemd[1]: Started D-Bus System Message Bus.888gitlab # [ 7.632105] dbus-broker-launch[576]: Ready889gitlab # [ 7.639378] systemd[1]: Reached target Basic System.890gitlab # [ 7.642531] systemd[1]: Started backdoor.service.891gitlab # [ 7.645546] systemd[1]: Starting gitlab-config.service...892gitlab # [ 7.656390] systemd[1]: Starting Import lastlog data into lastlog2 database...893gitlab # [ 7.660796] systemd[1]: Starting Logrotate configuration check...894gitlab # [ 7.667286] systemd[1]: Starting Name Service Cache Daemon (nsncd)...895gitlab # connecting to host...896gitlab # [ 7.679158] systemd[1]: Starting Post-Boot Actions...897gitlab # [ 7.682288] systemd[1]: Started Reset console on configuration changes.898gitlab # [ 7.691521] systemd[1]: Starting resolvconf update...899gitlab # [ 7.695836] logrotate[581]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.900gitlab # [ 7.700176] logrotate[581]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf901gitlab # [ 7.703397] logrotate[581]: note: 'monthly' overrides previously specified 'weekly'902gitlab: Guest shell says: b'Spawning backdoor root shell...\n'903gitlab # [ 7.704380] logrotate[581]: Reading state from file: /var/lib/logrotate.status904gitlab # [ 7.705873] logrotate[581]: state file /var/lib/logrotate.status does not exist905gitlab: connected to guest root shell906gitlab # [ 7.708155] logrotate[581]: Allocating hash table for state file, size 64 entries907gitlab: (connecting took 8.54 seconds)908gitlab # [ 7.709273] logrotate[581]: Handling 4 logs909gitlab: (finished: waiting for the VM to finish booting, in 8.54 seconds)910gitlab # [ 7.709955] logrotate[581]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed911gitlab # [ 7.712069] logrotate[581]: considering log /var/log/btmp912gitlab # [ 7.713140] logrotate[581]: Creating new state913gitlab # [ 7.713868] logrotate[581]: Now: 2026-08-11 10:46914gitlab # [ 7.714949] logrotate[581]: Last rotated at 2026-08-11 10:00915gitlab # [ 7.716048] logrotate[581]: log does not need rotating (log has already been rotated)916gitlab # [ 7.716898] logrotate[581]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed917gitlab # [ 7.718168] logrotate[581]: considering log /var/log/wtmp918gitlab # [ 7.718910] logrotate[581]: Creating new state919gitlab # [ 7.721373] logrotate[581]: Now: 2026-08-11 10:46920gitlab # [ 7.722305] logrotate[581]: Last rotated at 2026-08-11 10:00921gitlab # [ 7.723240] logrotate[581]: log does not need rotating (log has already been rotated)922gitlab # [ 7.724418] logrotate[581]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed923gitlab # [ 7.725189] logrotate[581]: switching euid from 0 to 165 and egid from 0 to 165 (pid 581)924gitlab # [ 7.726082] logrotate[581]: considering log /var/gitlab/state/log/*.log925gitlab # [ 7.726968] logrotate[581]: log /var/gitlab/state/log/*.log does not exist -- skipping926gitlab # [ 7.728173] logrotate[581]: Creating new state927gitlab # [ 7.729074] logrotate[581]: switching euid from 165 to 0 and egid from 165 to 0 (pid 581)928gitlab # [ 7.729921] logrotate[581]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed929gitlab # [ 7.731073] logrotate[581]: switching euid from 0 to 60 and egid from 0 to 60 (pid 581)930gitlab # [ 7.732041] logrotate[581]: considering log /var/log/nginx/*.log931gitlab # [ 7.732694] logrotate[581]: log /var/log/nginx/*.log does not exist -- skipping932gitlab # [ 7.733928] logrotate[581]: Creating new state933gitlab # [ 7.735533] logrotate[581]: not running postrotate script, since no logs were rotated934gitlab # [ 7.736197] logrotate[581]: switching euid from 60 to 0 and egid from 60 to 0 (pid 581)935gitlab # [ 7.737532] nsncd[585]: Aug 11 10:46:50.411 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"936gitlab # [ 7.739191] systemd[1]: Finished Logrotate configuration check.937gitlab # [ 7.756723] systemd[1]: Finished Post-Boot Actions.938gitlab # [ 7.757824] systemd[1]: Started Name Service Cache Daemon (nsncd).939gitlab # [ 7.758926] systemd[1]: Finished Import lastlog data into lastlog2 database.940gitlab # [ 7.772593] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...941gitlab # [ 7.775506] systemd[1]: nscd.service: Deactivated successfully.942gitlab # [ 7.776832] systemd[1]: Stopped Name Service Cache Daemon (nsncd).943gitlab # [ 7.778879] systemd[1]: nscd.service: Consumed 22ms CPU time over 107ms wall clock time, 7.2M memory peak, 5.5M read from disk.944gitlab # [ 7.783767] systemd[1]: Starting Name Service Cache Daemon (nsncd)...945gitlab # [ 7.801797] nsncd[663]: Aug 11 10:46:50.492 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"946gitlab # [ 7.805443] systemd[1]: Started Name Service Cache Daemon (nsncd).947gitlab # [ 7.807065] systemd[1]: Reached target Host and Network Name Lookups.948gitlab # [ 7.808697] systemd[1]: Reached target User and Group Name Lookups.949gitlab # [ 7.810282] systemd[1]: Starting User Login Management...950gitlab # [ 7.816176] systemd[1]: Finished resolvconf update.951gitlab # [ 7.818209] systemd[1]: Reached target Preparation for Network.952gitlab # [ 7.820816] systemd[1]: Starting DHCP Client...953gitlab # [ 7.825090] systemd[1]: Starting Address configuration of eth1...954gitlab # [ 7.832671] systemd[1]: Starting Extra networking commands....955gitlab # [ 7.853656] network-addresses-eth1-start[695]: adding address 192.168.1.1/24... done956gitlab # [ 7.856328] systemd-logind[687]: New seat seat0.957gitlab # [ 7.859683] systemd-logind[687]: Watching system buttons on /dev/input/event2 (Power Button)958gitlab # [ 7.862823] systemd-logind[687]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)959gitlab # [ 7.864928] network-addresses-eth1-start[695]: adding address 2001:db8:1::1/64... done960gitlab # [ 7.866050] systemd-logind[687]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)961gitlab # [ 7.866774] systemd[1]: Started User Login Management.962gitlab # [ 7.870316] systemd[1]: Starting linger-users.service...963gitlab # [ 7.880853] systemd[1]: Finished Address configuration of eth1.964gitlab # [ 7.886809] systemd[1]: linger-users.service: Deactivated successfully.965gitlab # [ 7.889848] systemd[1]: Finished linger-users.service.966gitlab # [ 7.918080] systemd[1]: Finished Extra networking commands..967gitlab # [ 7.920843] systemd[1]: Reached target Network.968gitlab # [ 7.925604] systemd[1]: Starting gitlab-workhorse.service...969gitlab # [ 7.929698] systemd[1]: Starting Nginx Web Server...970gitlab # [ 7.933723] systemd[1]: Starting PostgreSQL Server...971gitlab # [ 7.935794] dhcpcd[723]: dhcpcd-10.3.2 starting972gitlab # [ 7.939348] dhcpcd[767]: dev: loaded udev973gitlab # [ 7.942798] systemd[1]: Starting Redis Server - redis-gitlab...974gitlab # [ 7.943881] systemd[1]: Starting Permit User Sessions...975gitlab # [ 8.213239] 8021q: 802.1Q VLAN Support v1.8976gitlab # [ 8.214183] 8021q: adding VLAN 0 to HW filter on device eth1977gitlab # [ 7.967720] systemd[1]: Finished Permit User Sessions.978gitlab # [ 7.971344] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.979gitlab # [ 7.979622] systemd[1]: Started Getty on tty1.980gitlab # [ 7.980730] systemd[1]: Reached target Login Prompts.981gitlab # [ 8.315524] cfg80211: Loading compiled-in X.509 certificates for regulatory database982gitlab # [ 8.322462] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'983gitlab # [ 8.326879] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'984gitlab # [ 8.329655] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2985gitlab # [ 8.332346] cfg80211: failed to load regulatory.db986gitlab # [ 8.080638] nginx-pre-start[787]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok987gitlab # [ 8.082107] nginx-pre-start[787]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful988gitlab # [ 8.091068] systemd[1]: Started Nginx Web Server.989gitlab # [ 8.372220] 8021q: adding VLAN 0 to HW filter on device eth0990gitlab # [ 8.108311] dhcpcd[767]: eth0: waiting for carrier991gitlab # [ 8.109527] dhcpcd[767]: eth0: carrier acquired992gitlab # [ 8.113821] dhcpcd[767]: DUID 00:01:00:01:32:0d:ba:1a:52:54:00:12:34:56993gitlab # [ 8.115117] dhcpcd[767]: eth0: IAID 00:12:34:56994gitlab # [ 8.116571] dhcpcd[767]: eth0: adding address fe80::5054:ff:fe12:3456995gitlab # [ 8.118308] redis-server[789]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.996gitlab # [ 8.119630] redis-server[789]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo997gitlab # [ 8.121055] postgresql-pre-start[793]: The files belonging to this database system will be owned by user "postgres".998gitlab # [ 8.121728] postgresql-pre-start[793]: This user must also own the server process.999gitlab # [ 8.122941] redis-server[789]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=789, just started1000gitlab # [ 8.123673] redis-server[789]: Configuration loaded1001gitlab # [ 8.126946] postgresql-pre-start[793]: The database cluster will be initialized with locale "en_US.UTF-8".1002gitlab # [ 8.128134] postgresql-pre-start[793]: The default database encoding has accordingly been set to "UTF8".1003gitlab # [ 8.128663] postgresql-pre-start[793]: The default text search configuration will be set to "english".1004gitlab # [ 8.130457] postgresql-pre-start[793]: Data page checksums are enabled.1005gitlab # [ 8.131362] postgresql-pre-start[793]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1006gitlab # [ 8.132090] postgresql-pre-start[793]: creating subdirectories ... ok1007gitlab # [ 8.132901] postgresql-pre-start[793]: selecting dynamic shared memory implementation ... posix1008gitlab # [ 8.144674] redis[789]: monotonic clock: POSIX clock_gettime1009gitlab # [ 8.150215] redis[789]: Running mode=standalone, port=0.1010gitlab # [ 8.151443] systemd[1]: Started Redis Server - redis-gitlab.1011gitlab # [ 8.152915] redis[789]: Server initialized1012gitlab # [ 8.155298] redis[789]: Ready to accept connections unix1013gitlab # [ 8.157293] redis[789]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1014gitlab # [ 8.174159] postgresql-pre-start[793]: selecting default "max_connections" ... 1001015gitlab # [ 8.223659] postgresql-pre-start[793]: selecting default "shared_buffers" ... 128MB1016gitlab # [ 8.473264] systemd[1]: Started gitlab-workhorse.service.1017gitlab # [ 8.606212] postgresql-pre-start[793]: selecting default time zone ... UTC1018gitlab # [ 8.609778] postgresql-pre-start[793]: creating configuration files ... ok1019gitlab # [ 8.661103] gitlab-workhorse[824]: time="2026-08-11T10:46:51Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41020gitlab # [ 8.663588] gitlab-workhorse[824]: time="2026-08-11T10:46:51Z" level=info msg="Using redis/go-redis"1021gitlab # [ 8.667663] gitlab-workhorse[824]: time="2026-08-11T10:46:51Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1022gitlab # [ 8.728457] dhcpcd[767]: eth0: soliciting a DHCP lease1023gitlab # [ 9.000902] NET: Registered PF_PACKET protocol family1024gitlab # [ 8.748761] dhcpcd[767]: eth0: offered 10.0.2.15 from 10.0.2.21025gitlab # [ 8.755384] dhcpcd[767]: eth0: probing address 10.0.2.15/241026gitlab # [ 8.783307] postgresql-pre-start[793]: running bootstrap script ... ok1027gitlab # [ 9.282561] postgresql-pre-start[793]: performing post-bootstrap initialization ... ok1028gitlab # [ 9.709271] postgresql-pre-start[793]: syncing data to disk ... ok1029gitlab # [ 9.713416] postgresql-pre-start[793]: initdb: warning: enabling "trust" authentication for local connections1030gitlab # [ 9.719354] postgresql-pre-start[793]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1031gitlab # [ 9.728436] postgresql-pre-start[793]: Success. You can now start the database server using:1032gitlab # [ 9.733441] postgresql-pre-start[793]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1033gitlab # [ 9.829202] postgres[849]: [849] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1034gitlab # [ 9.832034] postgres[849]: [849] LOG: listening on IPv6 address "::1", port 54321035gitlab # [ 9.833303] postgres[849]: [849] LOG: listening on IPv4 address "127.0.0.1", port 54321036gitlab # [ 9.837381] postgres[849]: [849] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1037gitlab # [ 9.854496] postgres[866]: [866] LOG: database system was shut down at 2026-08-11 10:46:51 GMT1038gitlab # [ 9.865452] postgres[849]: [849] LOG: database system is ready to accept connections1039gitlab # [ 9.870903] systemd[1]: Started PostgreSQL Server.1040gitlab # [ 9.873616] systemd[1]: Starting PostgreSQL Setup Scripts...1041gitlab # [ 10.068725] postgresql-setup-start[879]: CREATE DATABASE1042gitlab # [ 10.108498] postgresql-setup-start[884]: CREATE ROLE1043gitlab # [ 10.119255] postgresql-setup-start[886]: ALTER DATABASE1044gitlab # [ 10.146215] postgresql-setup-start[891]: CREATE ROLE1045gitlab # [ 10.148931] systemd[1]: Finished PostgreSQL Setup Scripts.1046gitlab # [ 10.151871] systemd[1]: Reached target PostgreSQL.1047gitlab # [ 10.153809] systemd[1]: Starting gitlab-postgresql.service...1048gitlab # [ 10.266069] gitlab-postgresql-start[899]: CREATE DATABASE1049gitlab # [ 10.324826] gitlab-postgresql-start[908]: CREATE EXTENSION1050gitlab # [ 10.334830] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[904]: mkdir -p /var/gitlab/state/home/.ssh: OK1051gitlab # [ 10.337851] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[904]: chmod 700 /var/gitlab/state/home/.ssh: OK1052gitlab # [ 10.378253] systemd[1]: Finished gitlab-config.service.1053gitlab # [ 10.384295] systemd[1]: Started gitaly.service.1054gitlab # [ 10.389092] systemd[1]: Starting gitlab-db-config.service...1055gitlab # [ 10.421154] gitlab-postgresql-start[910]: CREATE EXTENSION1056gitlab # [ 10.424345] systemd[1]: Finished gitlab-postgresql.service.1057gitlab # [ 10.603282] dhcpcd[767]: eth0: soliciting an IPv6 router1058gitlab # [ 10.605461] dhcpcd[767]: eth0: Router Advertisement from fe80::21059gitlab # [ 10.607842] dhcpcd[767]: eth0: adding address fec0::5054:ff:fe12:3456/641060gitlab # [ 10.610832] dhcpcd[767]: eth0: adding route to fec0::/641061gitlab # [ 10.612772] dhcpcd[767]: eth0: adding default route via fe80::21062gitlab # [ 10.925382] gitaly[924]: time="2026-08-11T10:46:53.615Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9241063gitlab # [ 10.927209] gitaly[924]: time="2026-08-11T10:46:53.616Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9241064gitlab # [ 10.928991] gitaly[924]: time="2026-08-11T10:46:53.616Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9241065gitlab # [ 10.930262] gitaly[924]: time="2026-08-11T10:46:53.616Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9241066gitlab # [ 10.931419] gitaly[924]: time="2026-08-11T10:46:53.616Z" level=info msg="Starting Gitaly" pid=924 version=1067gitlab # [ 11.109566] gitaly[924]: time="2026-08-11T10:46:53.800Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=168 pid=9241068gitlab # [ 11.113140] gitaly[924]: time="2026-08-11T10:46:53.800Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9241069gitlab # [ 11.116319] gitaly[924]: time="2026-08-11T10:46:53.801Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9241070gitlab # [ 11.119519] gitaly[924]: time="2026-08-11T10:46:53.801Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-924/git-exec-3636078974.d/git pid=9241071gitlab # [ 11.123228] gitaly[924]: time="2026-08-11T10:46:53.805Z" level=info msg="finished detecting git version" duration_ms=4 pid=9241072gitlab # [ 11.126346] gitaly[924]: time="2026-08-11T10:46:53.805Z" level=info msg="using Git version" pid=924 version=2.53.g1073gitlab # [ 11.129105] gitaly[924]: time="2026-08-11T10:46:53.806Z" level=info msg="clearing disk cache object folder" pid=924 storage=default1074gitlab # [ 11.132228] gitaly[924]: time="2026-08-11T10:46:53.806Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3600047296 pid=924 storage=default1075gitlab # [ 11.136920] gitaly[924]: time="2026-08-11T10:46:53.806Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3600047296 pid=924 storage=default1076gitlab # [ 11.142143] gitaly[924]: time="2026-08-11T10:46:53.806Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9241077gitlab # [ 11.146934] gitaly[924]: time="2026-08-11T10:46:53.806Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9241078gitlab # [ 11.151823] gitaly[924]: time="2026-08-11T10:46:53.806Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3600047296 clear_duration_ms=0 pid=924 storage=default1079gitlab # [ 11.185751] gitaly[924]: time="2026-08-11T10:46:53.876Z" level=info msg="finished tempdir cleaner walk" pid=924 storage=default time_ms=01080gitlab # [ 11.188851] gitaly[924]: time="2026-08-11T10:46:53.877Z" level=info msg="counting repositories" pid=9241081gitlab # [ 11.191442] gitaly[924]: time="2026-08-11T10:46:53.877Z" level=info msg="starting to count repositories" pid=924 storage_path=/var/gitlab/state/repositories1082gitlab # [ 11.195149] gitaly[924]: time="2026-08-11T10:46:53.877Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9241083gitlab # [ 11.199280] gitaly[924]: time="2026-08-11T10:46:53.877Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=924 schema=unix1084gitlab # [ 11.203323] gitaly[924]: time="2026-08-11T10:46:53.877Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=924 storage_path=/var/gitlab/state/repositories1085gitlab # [ 11.204361] gitaly[924]: time="2026-08-11T10:46:53.877Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9241086gitlab # [ 11.205210] gitaly[924]: time="2026-08-11T10:46:53.877Z" level=info msg="listening at address" address=/run/gitaly/gitaly-924/sock.d/intern pid=924 schema=unix1087gitlab # [ 11.206294] gitaly[924]: time="2026-08-11T10:46:53.892Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9241088gitlab # [ 11.206836] gitaly[924]: time="2026-08-11T10:46:53.892Z" level=info msg="Started Gitaly" duration_ms=276 pid=9241089gitlab # [ 11.208156] gitaly[924]: time="2026-08-11T10:46:53.893Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9241090gitlab # [ 11.209167] gitaly[924]: time="2026-08-11T10:46:53.893Z" level=info msg="maintenance: daily scheduled" pid=924 scheduled="2026-08-11 12:00:00 +0000 UTC"1091gitlab # [ 11.754611] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[927]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1092gitlab # [ 11.758255] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[927]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1093gitlab # [ 11.783613] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[927]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1094gitlab # [ 13.085482] gitaly[924]: time="2026-08-11T10:46:55.776Z" level=info msg="License database preloaded" duration_ms=2159 pid=9241095gitlab # [ 14.240671] dhcpcd[767]: eth0: leased 10.0.2.15 for 86400 seconds1096gitlab # [ 14.242819] dhcpcd[767]: eth0: adding route to 10.0.2.0/241097gitlab # [ 14.244588] dhcpcd[767]: eth0: adding default route via 10.0.2.21098gitlab # [ 14.385954] systemd[1]: Started DHCP Client.1099gitlab # [ 14.389709] systemd[1]: Reached target Network is Online.1100gitlab # [ 42.639469] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[927]: W, [2026-08-11T10:47:25.329847 #927] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1101gitlab # [ 44.656672] postgres[1318]: [1318] ERROR: relation "feature_gates" does not exist at character 5231102gitlab # [ 44.658919] postgres[1318]: [1318] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1103gitlab # [ 44.661061] postgres[1318]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1104gitlab # [ 44.663310] postgres[1318]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1105gitlab # [ 44.665370] postgres[1318]: attidentity AS identity,1106gitlab # [ 44.666766] postgres[1318]: attgenerated as attgenerated1107gitlab # [ 44.668306] postgres[1318]: FROM pg_attribute a1108gitlab # [ 44.669584] postgres[1318]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1109gitlab # [ 44.671792] postgres[1318]: LEFT JOIN pg_type t ON a.atttypid = t.oid1110gitlab # [ 44.673447] postgres[1318]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1111gitlab # [ 44.675977] postgres[1318]: WHERE a.attrelid = '"feature_gates"'::regclass1112gitlab # [ 44.677705] postgres[1318]: AND a.attnum > 0 AND NOT a.attisdropped1113gitlab # [ 44.679302] postgres[1318]: ORDER BY a.attnum1114gitlab # [ 44.680487] postgres[1318]:1115gitlab # [ 48.245258] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1360]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1116gitlab # [ 48.247603] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1360]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1117gitlab # [ 48.727426] gitlab-workhorse[824]: time="2026-08-11T10:47:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1118gitlab # [ 58.737323] gitlab-workhorse[824]: time="2026-08-11T10:47:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1119gitlab # [ 66.996747] postgres[1444]: [1444] ERROR: relation "table_without_models" does not exist1120gitlab # [ 67.001788] postgres[1444]: [1444] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1121gitlab # [ 68.739284] gitlab-workhorse[824]: time="2026-08-11T10:47:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 78.749494] gitlab-workhorse[824]: time="2026-08-11T10:48:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1123gitlab # [ 81.629125] systemd[1]: Finished gitlab-db-config.service.1124gitlab # [ 81.636796] systemd[1]: Started gitlab-sidekiq.service.1125gitlab # [ 81.645245] systemd[1]: Starting gitlab.service...1126gitlab # [ 82.063396] bundle[1647]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1127gitlab # [ 82.071816] bundle[1647]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1128gitlab # [ 82.079882] bundle[1647]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1129gitlab # [ 84.904619] sidekiq-cluster[1646]: {"severity":"INFO","time":"2026-08-11T10:48:07.577Z","message":"Starting cluster with 1 processes"}1130gitlab # [ 85.049148] bundle[1647]: {"timestamp":"2026-08-11T10:48:07.719Z","pid":1647,"message":"* Enabling systemd notification integration"}1131gitlab # [ 85.055686] bundle[1647]: {"timestamp":"2026-08-11T10:48:07.739Z","pid":1647,"message":"Puma starting in cluster mode..."}1132gitlab # [ 85.061684] bundle[1647]: {"timestamp":"2026-08-11T10:48:07.739Z","pid":1647,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1133gitlab # [ 85.068362] bundle[1647]: {"timestamp":"2026-08-11T10:48:07.739Z","pid":1647,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1134gitlab # [ 85.076285] bundle[1647]: {"timestamp":"2026-08-11T10:48:07.739Z","pid":1647,"message":"* Min threads: 0"}1135gitlab # [ 85.081790] bundle[1647]: {"timestamp":"2026-08-11T10:48:07.739Z","pid":1647,"message":"* Max threads: 4"}1136gitlab # [ 85.087276] bundle[1647]: {"timestamp":"2026-08-11T10:48:07.739Z","pid":1647,"message":"* Environment: production"}1137gitlab # [ 85.093009] bundle[1647]: {"timestamp":"2026-08-11T10:48:07.739Z","pid":1647,"message":"* Master PID: 1647"}1138gitlab # [ 85.098431] bundle[1647]: {"timestamp":"2026-08-11T10:48:07.739Z","pid":1647,"message":"* Workers: 2"}1139gitlab # [ 85.102639] bundle[1647]: {"timestamp":"2026-08-11T10:48:07.739Z","pid":1647,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1140gitlab # [ 85.107924] bundle[1647]: {"timestamp":"2026-08-11T10:48:07.740Z","pid":1647,"message":"* Preloading application"}1141gitlab # [ 88.759537] gitlab-workhorse[824]: time="2026-08-11T10:48:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1142gitlab # [ 98.771186] gitlab-workhorse[824]: time="2026-08-11T10:48:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143gitlab # [ 108.779943] gitlab-workhorse[824]: time="2026-08-11T10:48:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144gitlab # [ 109.023131] bundle[1647]: W, [2026-08-11T10:48:31.713289 #1647] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1145gitlab # [ 111.424528] sidekiq-cluster[1686]: 2026-08-11T10:48:34.114Z pid=1686 tid=wfy INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1686, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433369088}1146gitlab # [ 111.605966] sidekiq-cluster[1686]: W, [2026-08-11T10:48:34.296988 #1686] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1147gitlab # [ 111.645422] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:34.336Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1148gitlab # [ 113.671156] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.361Z","message":"GitLab reliable fetch activated!"}1149gitlab # [ 113.677919] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.361Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1150gitlab # [ 113.698653] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.389Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1151gitlab # [ 113.724362] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.415Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1152gitlab # [ 113.742687] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.433Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1153gitlab # [ 113.751414] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.439Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1154gitlab # [ 113.762975] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.454Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1155gitlab # [ 113.777463] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.468Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1156gitlab # [ 113.792120] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.483Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1157gitlab # [ 113.806396] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.497Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1158gitlab # [ 113.820581] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.511Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1159gitlab # [ 113.834717] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.525Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1160gitlab # [ 113.848870] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.539Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1161gitlab # [ 113.862801] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.553Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1162gitlab # [ 113.875126] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.566Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1163gitlab # [ 113.887677] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.578Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1164gitlab # [ 113.897720] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.588Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1165gitlab # [ 113.905265] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.596Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1166gitlab # [ 113.913252] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.604Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1167gitlab # [ 113.920935] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.611Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1168gitlab # [ 113.932893] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.624Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1169gitlab # [ 113.943449] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.634Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1170gitlab # [ 113.954238] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.645Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1171gitlab # [ 113.965264] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.656Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1172gitlab # [ 113.975720] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.666Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1173gitlab # [ 113.985183] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.676Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1174gitlab # [ 113.994826] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.685Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1175gitlab # [ 114.006693] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.697Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1176gitlab # [ 114.021370] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.712Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1177gitlab # [ 114.033147] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.724Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1178gitlab # [ 114.046963] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.738Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1179gitlab # [ 114.057277] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.748Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1180gitlab # [ 114.065896] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.757Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1181gitlab # [ 114.073772] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.765Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1182gitlab # [ 114.080218] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.771Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1183gitlab # [ 114.092526] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.783Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1184gitlab # [ 114.102615] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.793Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1185gitlab # [ 114.111750] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.802Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1186gitlab # [ 114.122490] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.813Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1187gitlab # [ 114.132884] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.823Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1188gitlab # [ 114.143462] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.834Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1189gitlab # [ 114.152413] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.843Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1190gitlab # [ 114.163209] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.854Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1191gitlab # [ 114.172681] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.863Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1192gitlab # [ 114.184874] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.875Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1193gitlab # [ 114.195223] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.886Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1194gitlab # [ 114.206606] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.897Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1195gitlab # [ 114.217807] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.908Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1196gitlab # [ 114.226975] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.918Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1197gitlab # [ 114.237204] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.928Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1198gitlab # [ 114.247616] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.938Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1199gitlab # [ 114.257464] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.948Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1200gitlab # [ 114.268888] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.960Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1201gitlab # [ 114.279645] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.970Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1202gitlab # [ 114.305880] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:36.997Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1203gitlab # [ 114.322759] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.013Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1204gitlab # [ 114.336930] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.028Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1205gitlab # [ 114.351620] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.042Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1206gitlab # [ 114.365508] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.056Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1207gitlab # [ 114.381168] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.072Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1208gitlab # [ 114.394750] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.085Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1209gitlab # [ 114.410881] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.101Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1210gitlab # [ 114.425540] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.116Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1211gitlab # [ 114.437873] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.128Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1212gitlab # [ 114.452867] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.144Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1213gitlab # [ 114.468207] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.159Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1214gitlab # [ 114.482612] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.173Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1215gitlab # [ 114.538058] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.227Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1216gitlab # [ 114.550265] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.241Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1217gitlab # [ 114.560223] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.251Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1218gitlab # [ 114.567176] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.258Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1219gitlab # [ 114.573424] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.264Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1220gitlab # [ 114.580153] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.271Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1221gitlab # [ 114.586056] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.277Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1222gitlab # [ 114.593213] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.284Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1223gitlab # [ 114.599639] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.290Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1224gitlab # [ 114.606200] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.297Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1225gitlab # [ 114.612941] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.304Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1226gitlab # [ 114.619662] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.310Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1227gitlab # [ 114.626098] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.317Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1228gitlab # [ 114.632404] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.323Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1229gitlab # [ 114.638417] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.329Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1230gitlab # [ 114.645443] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.336Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1231gitlab # [ 114.653178] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.344Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1232gitlab # [ 114.660194] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.351Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1233gitlab # [ 114.666443] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.357Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1234gitlab # [ 114.674201] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.364Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1235gitlab # [ 114.678119] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.368Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1236gitlab # [ 114.682365] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.372Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1237gitlab # [ 114.691992] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.383Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1238gitlab # [ 114.700541] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.391Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1239gitlab # [ 114.708711] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.399Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1240gitlab # [ 114.716781] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.407Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1241gitlab # [ 114.724974] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.416Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1242gitlab # [ 114.733776] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.424Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1243gitlab # [ 114.742142] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.433Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1244gitlab # [ 114.754629] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.445Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1245gitlab # [ 114.765682] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.456Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1246gitlab # [ 114.774858] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.465Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1247gitlab # [ 114.784647] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.475Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1248gitlab # [ 114.809888] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.500Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1249gitlab # [ 114.817117] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.508Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1250gitlab # [ 114.825960] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.517Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1251gitlab # [ 114.838996] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.530Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1252gitlab # [ 114.850154] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.541Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1253gitlab # [ 114.859637] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.550Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1254gitlab # [ 114.871597] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.562Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1255gitlab # [ 114.880661] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.571Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1256gitlab # [ 114.890519] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.581Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1257gitlab # [ 114.901539] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.592Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1258gitlab # [ 114.911180] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:48:37.602Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1259gitlab # [ 118.790592] gitlab-workhorse[824]: time="2026-08-11T10:48:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1260gitlab # [ 128.793425] gitlab-workhorse[824]: time="2026-08-11T10:48:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1261gitlab # [ 135.904304] postgres[2152]: [2152] ERROR: relation "table_without_models" does not exist1262gitlab # [ 135.906487] postgres[2152]: [2152] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1263gitlab # [ 136.452126] postgres[2163]: [2163] ERROR: relation "table_without_models" does not exist1264gitlab # [ 136.454203] postgres[2163]: [2163] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1265gitlab # [ 138.583517] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:01.271Z","message":"Booted Rails 7.2.3.1 application in production environment"}1266gitlab # [ 138.588636] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:01.278Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1267gitlab # [ 138.599339] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:01.278Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1268gitlab # [ 138.606739] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:01.278Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1269gitlab # [ 138.615209] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:01.282Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1270gitlab # [ 138.796631] gitlab-workhorse[824]: time="2026-08-11T10:49:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1271gitlab # [ 139.449450] bundle[1647]: {"timestamp":"2026-08-11T10:49:02.139Z","pid":1647,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1272gitlab # [ 139.457307] bundle[1647]: {"timestamp":"2026-08-11T10:49:02.139Z","pid":1647,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1273gitlab # [ 139.464555] bundle[1647]: {"timestamp":"2026-08-11T10:49:02.139Z","pid":1647,"message":"! #\u003cThread:0x00007b66525afc38 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1274gitlab # [ 139.483317] bundle[1647]: {"timestamp":"2026-08-11T10:49:02.140Z","pid":1647,"message":"! #\u003cThread:0x00007b66527d3168 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1275gitlab # [ 139.497729] bundle[1647]: {"timestamp":"2026-08-11T10:49:02.140Z","pid":1647,"message":"Use Ctrl-C to stop"}1276gitlab # [ 139.499929] bundle[1647]: {"timestamp":"2026-08-11T10:49:02.140Z","pid":1647,"message":"Sending status to systemd every 1.0 sec"}1277gitlab # [ 139.867929] bundle[1647]: {"timestamp":"2026-08-11T10:49:02.557Z","pid":1647,"message":"- Worker 0 (PID: 2210) booted in 0.36s, phase: 0"}1278gitlab # [ 139.906756] bundle[1647]: {"timestamp":"2026-08-11T10:49:02.597Z","pid":1647,"message":"- Worker 1 (PID: 2214) booted in 0.37s, phase: 0"}1279gitlab # [ 139.914759] systemd[1]: Started gitlab.service.1280gitlab # [ 139.918127] systemd[1]: Reached target Common target for all GitLab services..1281gitlab # [ 139.922578] systemd[1]: Starting setup-gitlab.service...1282gitlab # [ 139.936087] setup-gitlab-start[2238]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1283gitlab # [ 139.973138] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:02.663Z","message":"Cleaning working queues"}1284gitlab # [ 139.977127] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:02.666Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"03256ddcf28797826829012c","created_at":"2026-08-11T10:48:03.865Z","trace_propagation_headers":{"sentry-trace":"ac4df5767f234c6ca315642bda0f746f-4f7c1227e5a9418f","baggage":"sentry-trace_id=ac4df5767f234c6ca315642bda0f746f,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"8d3f04298c964b6bb3ea31fdee94320c","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T10:48:03.877Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-03256ddcf28797826829012c: start","job_status":"start","queue_duration_s":58.789107,"scheduling_latency_s":58.789163}1285gitlab # [ 140.127800] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:02.818Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"03256ddcf28797826829012c","created_at":"2026-08-11T10:48:03.865Z","trace_propagation_headers":{"sentry-trace":"ac4df5767f234c6ca315642bda0f746f-4f7c1227e5a9418f","baggage":"sentry-trace_id=ac4df5767f234c6ca315642bda0f746f,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"8d3f04298c964b6bb3ea31fdee94320c","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T10:48:03.877Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-03256ddcf28797826829012c: done: 0.152479 sec","job_status":"done","queue_duration_s":58.789107,"scheduling_latency_s":58.789163,"redis_calls":26,"redis_duration_s":0.008783,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.004761,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002385,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001637,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.073522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08310078500000001,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.152479,"completed_at":"2026-08-11T10:49:02.818Z","load_balancing_strategy":"primary","db_duration_s":0.045527,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1286gitlab # [ 142.340460] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:49:05 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 23741287gitlab # [ 142.348833] setup-gitlab-start[2238]: + TOKEN=nixbot-test-token-of-20-chars1288gitlab # [ 142.352416] setup-gitlab-start[2238]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1289gitlab # [ 142.380351] runuser[2267]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1290gitlab # [ 142.812144] setup-gitlab-start[2268]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1291gitlab # [ 142.814869] setup-gitlab-start[2268]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1292gitlab # [ 142.818277] setup-gitlab-start[2268]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1293gitlab # [ 143.445564] setup-gitlab-start[2268]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1294gitlab # [ 143.449546] setup-gitlab-start[2268]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1295gitlab # [ 143.452219] setup-gitlab-start[2268]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1296gitlab # [ 155.017563] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:17.707Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"e3cb487e315fa9db48ebf481","created_at":"2026-08-11T10:49:17.677Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8685163716d1a4a210143a270b82a079","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:17.705Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-e3cb487e315fa9db48ebf481: start","job_status":"start","queue_duration_s":0.001808,"scheduling_latency_s":0.001839}1297gitlab # [ 155.153600] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:17.843Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"e3cb487e315fa9db48ebf481","created_at":"2026-08-11T10:49:17.677Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8685163716d1a4a210143a270b82a079","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:17.705Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-e3cb487e315fa9db48ebf481: done: 0.136345 sec","job_status":"done","queue_duration_s":0.001808,"scheduling_latency_s":0.001839,"redis_calls":12,"redis_duration_s":0.019595,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005676,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007284,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006635,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001570591,"duration_s":0.136345,"completed_at":"2026-08-11T10:49:17.843Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006473,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 155.248308] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:17.938Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"c1a670cf634b345341ddb5f2","created_at":"2026-08-11T10:49:17.762Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d5c11d2f738968f299d6b998b17eace","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:17.784Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-c1a670cf634b345341ddb5f2: start","job_status":"start","queue_duration_s":0.154112,"scheduling_latency_s":0.154179}1299gitlab # [ 155.311394] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.000Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"c1a670cf634b345341ddb5f2","created_at":"2026-08-11T10:49:17.762Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d5c11d2f738968f299d6b998b17eace","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:17.784Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-c1a670cf634b345341ddb5f2: done: 0.061779 sec","job_status":"done","queue_duration_s":0.154112,"scheduling_latency_s":0.154179,"redis_calls":10,"redis_duration_s":0.01471,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003458,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009636,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001616,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001277257,"duration_s":0.061779,"completed_at":"2026-08-11T10:49:18.000Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003772,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 155.376438] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.007Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"612f22e3eb7ecc9697c7cd74","created_at":"2026-08-11T10:49:17.805Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed56774c5829a6bc403bf73233d61436","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:17.830Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-612f22e3eb7ecc9697c7cd74: start","job_status":"start","queue_duration_s":0.176942,"scheduling_latency_s":0.176986}1301gitlab # [ 155.433205] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.123Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"612f22e3eb7ecc9697c7cd74","created_at":"2026-08-11T10:49:17.805Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed56774c5829a6bc403bf73233d61436","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:17.830Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-612f22e3eb7ecc9697c7cd74: done: 0.115676 sec","job_status":"done","queue_duration_s":0.176942,"scheduling_latency_s":0.176986,"redis_calls":10,"redis_duration_s":0.019133,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002302,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.014485,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002346,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.054,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.054,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001031416,"duration_s":0.115676,"completed_at":"2026-08-11T10:49:18.123Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.057338,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 155.469899] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.128Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"d2842f5275fec1c9b118177b","created_at":"2026-08-11T10:49:17.933Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a17aa5e6b8fe489dff0e2f5e25ef7b19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:17.969Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-d2842f5275fec1c9b118177b: start","job_status":"start","queue_duration_s":0.158214,"scheduling_latency_s":0.158272}1303gitlab # [ 155.654647] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.345Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"d2842f5275fec1c9b118177b","created_at":"2026-08-11T10:49:17.933Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a17aa5e6b8fe489dff0e2f5e25ef7b19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:17.969Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-d2842f5275fec1c9b118177b: done: 0.217352 sec","job_status":"done","queue_duration_s":0.158214,"scheduling_latency_s":0.158272,"redis_calls":12,"redis_duration_s":0.017068,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.009079,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005152,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002837,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001030858,"exclusive_lock_hold_duration_s":0.163001443,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.217352,"completed_at":"2026-08-11T10:49:18.345Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.076883,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1304gitlab # [ 155.659590] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.347Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"1c2d46380252c74429474d62","created_at":"2026-08-11T10:49:17.997Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08ce9bb1230bf4d632e2c073bb0a6966","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T10:49:18.010Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-1c2d46380252c74429474d62: start","job_status":"start","queue_duration_s":0.337656,"scheduling_latency_s":0.337679}1305gitlab # [ 155.764917] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.381Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"1c2d46380252c74429474d62","created_at":"2026-08-11T10:49:17.997Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08ce9bb1230bf4d632e2c073bb0a6966","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T10:49:18.010Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-1c2d46380252c74429474d62: done: 0.033696 sec","job_status":"done","queue_duration_s":0.337656,"scheduling_latency_s":0.337679,"redis_calls":10,"redis_duration_s":0.002569,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000518,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001617,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000408432,"duration_s":0.033696,"completed_at":"2026-08-11T10:49:18.381Z","load_balancing_strategy":"primary","db_duration_s":0.009282,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 155.766948] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.383Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d0a68b8b0f0164fae6b3f32f","created_at":"2026-08-11T10:49:18.032Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df1528853c7ff944cd13f1ba59e0fdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:18.135Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d0a68b8b0f0164fae6b3f32f: start","job_status":"start","queue_duration_s":0.247865,"scheduling_latency_s":0.247885}1307gitlab # [ 155.789496] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.414Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d0a68b8b0f0164fae6b3f32f","created_at":"2026-08-11T10:49:18.032Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df1528853c7ff944cd13f1ba59e0fdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:18.135Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d0a68b8b0f0164fae6b3f32f: done: 0.031078 sec","job_status":"done","queue_duration_s":0.247865,"scheduling_latency_s":0.247885,"redis_calls":13,"redis_duration_s":0.005632,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000856,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002924,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001852,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00835609,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.031078,"completed_at":"2026-08-11T10:49:18.414Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004115,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1308gitlab # [ 155.861155] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.416Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"7707e22ee6282bbc8be4cc16","created_at":"2026-08-11T10:49:18.156Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f126d38702339e4079f5842b3ef38a21","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:18.175Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-7707e22ee6282bbc8be4cc16: start","job_status":"start","queue_duration_s":0.241244,"scheduling_latency_s":0.241265}1309gitlab # [ 155.931148] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.429Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1310gitlab # [ 155.932559] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.436Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"7707e22ee6282bbc8be4cc16","created_at":"2026-08-11T10:49:18.156Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f126d38702339e4079f5842b3ef38a21","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:18.175Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-7707e22ee6282bbc8be4cc16: done: 0.019823 sec","job_status":"done","queue_duration_s":0.241244,"scheduling_latency_s":0.241265,"redis_calls":10,"redis_duration_s":0.004223,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000796,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002581,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000846,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000609016,"duration_s":0.019823,"completed_at":"2026-08-11T10:49:18.436Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000671,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 156.004291] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.438Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"1a907955b9f5475b67f69044","created_at":"2026-08-11T10:49:18.202Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"030e8680cc8b25790d0b8001f8ee4085","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:18.207Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-1a907955b9f5475b67f69044: start","job_status":"start","queue_duration_s":0.231287,"scheduling_latency_s":0.231307}1312gitlab # [ 156.005280] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.451Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1313gitlab # [ 156.006201] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.465Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"1a907955b9f5475b67f69044","created_at":"2026-08-11T10:49:18.202Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"030e8680cc8b25790d0b8001f8ee4085","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:18.207Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-1a907955b9f5475b67f69044: done: 0.026251 sec","job_status":"done","queue_duration_s":0.231287,"scheduling_latency_s":0.231307,"redis_calls":10,"redis_duration_s":0.004542,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000852,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002856,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000834,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000595047,"duration_s":0.026251,"completed_at":"2026-08-11T10:49:18.465Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000698,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 156.098178] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.469Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b24e0ad8b7ed82023b5d03f5","created_at":"2026-08-11T10:49:18.215Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9761c0d122b88534e40cfa6b368f2ef","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:18.219Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b24e0ad8b7ed82023b5d03f5: start","job_status":"start","queue_duration_s":0.249499,"scheduling_latency_s":0.249547}1315gitlab # [ 156.099400] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.525Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b24e0ad8b7ed82023b5d03f5","created_at":"2026-08-11T10:49:18.215Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9761c0d122b88534e40cfa6b368f2ef","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:18.219Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b24e0ad8b7ed82023b5d03f5: done: 0.056452 sec","job_status":"done","queue_duration_s":0.249499,"scheduling_latency_s":0.249547,"redis_calls":14,"redis_duration_s":0.003406,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000865,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001342,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001199,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036417,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000549232,"exclusive_lock_hold_duration_s":0.029641757,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.056452,"completed_at":"2026-08-11T10:49:18.525Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008723,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 156.166275] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.527Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"5bfc6cf4f2697e525dcf6e80","created_at":"2026-08-11T10:49:18.234Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89ba59a11dcc0a06db9e4b5ee896fcc0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:18.244Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-5bfc6cf4f2697e525dcf6e80: start","job_status":"start","queue_duration_s":0.282965,"scheduling_latency_s":0.282987}1317gitlab # [ 156.167790] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.562Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"5bfc6cf4f2697e525dcf6e80","created_at":"2026-08-11T10:49:18.234Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89ba59a11dcc0a06db9e4b5ee896fcc0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:18.244Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-5bfc6cf4f2697e525dcf6e80: done: 0.035467 sec","job_status":"done","queue_duration_s":0.282965,"scheduling_latency_s":0.282987,"redis_calls":12,"redis_duration_s":0.003039,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000398,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001285,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001356,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000500622,"exclusive_lock_hold_duration_s":0.009056738,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.035467,"completed_at":"2026-08-11T10:49:18.562Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011675,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 156.295108] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:18.986Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"1d6f35d363968ead138f201d","created_at":"2026-08-11T10:49:18.339Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"524e3eefbca418b4dd6a107b34379208","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T10:49:18.984Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-1d6f35d363968ead138f201d: start","job_status":"start","queue_duration_s":0.001953,"scheduling_latency_s":0.001988}1319gitlab # [ 156.352402] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:19.043Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1320gitlab # [ 156.371717] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:19.062Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"1d6f35d363968ead138f201d","created_at":"2026-08-11T10:49:18.339Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"524e3eefbca418b4dd6a107b34379208","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T10:49:18.984Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-1d6f35d363968ead138f201d: done: 0.076322 sec","job_status":"done","queue_duration_s":0.001953,"scheduling_latency_s":0.001988,"redis_calls":10,"redis_duration_s":0.041913,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001729,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.025473,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.014711,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002584406,"duration_s":0.076322,"completed_at":"2026-08-11T10:49:19.062Z","load_balancing_strategy":"primary","db_duration_s":0.001521,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 156.436164] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:19.077Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"7757c8bef640a571963a136c","created_at":"2026-08-11T10:49:19.031Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d8c2cd15acdb1698ddce9c76dd10aa82","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.053Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-7757c8bef640a571963a136c: start","job_status":"start","queue_duration_s":0.023569,"scheduling_latency_s":0.023614}1322gitlab # [ 156.509211] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:19.199Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"7757c8bef640a571963a136c","created_at":"2026-08-11T10:49:19.031Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d8c2cd15acdb1698ddce9c76dd10aa82","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.053Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-7757c8bef640a571963a136c: done: 0.122622 sec","job_status":"done","queue_duration_s":0.023569,"scheduling_latency_s":0.023614,"redis_calls":10,"redis_duration_s":0.011172,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003225,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006548,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001399,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000886146,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.122622,"completed_at":"2026-08-11T10:49:19.199Z","load_balancing_strategy":"primary","db_duration_s":0.059652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 156.591118] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:19.281Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"7d83a2a1060d33a307520ac7","created_at":"2026-08-11T10:49:19.075Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0bde7438a57dd00542604030afa5269","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.092Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-7d83a2a1060d33a307520ac7: start","job_status":"start","queue_duration_s":0.189142,"scheduling_latency_s":0.189184}1324gitlab # [ 156.659749] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:19.350Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1325gitlab # [ 156.686458] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:19.377Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"7d83a2a1060d33a307520ac7","created_at":"2026-08-11T10:49:19.075Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0bde7438a57dd00542604030afa5269","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.092Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-7d83a2a1060d33a307520ac7: done: 0.095336 sec","job_status":"done","queue_duration_s":0.189142,"scheduling_latency_s":0.189184,"redis_calls":10,"redis_duration_s":0.017217,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006623,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006122,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004472,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001392636,"duration_s":0.095336,"completed_at":"2026-08-11T10:49:19.377Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00352,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 156.776600] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:19.467Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"79e558aeda2379ac0eb74a3a","created_at":"2026-08-11T10:49:19.112Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"018d2932b3ececc107d36a729154805b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.126Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-79e558aeda2379ac0eb74a3a: start","job_status":"start","queue_duration_s":0.340886,"scheduling_latency_s":0.340925}1327gitlab # [ 157.362104] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.051Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"79e558aeda2379ac0eb74a3a","created_at":"2026-08-11T10:49:19.112Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"018d2932b3ececc107d36a729154805b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.126Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-79e558aeda2379ac0eb74a3a: done: 0.584803 sec","job_status":"done","queue_duration_s":0.340886,"scheduling_latency_s":0.340925,"redis_calls":565,"redis_duration_s":0.24990800000000002,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005703,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006738,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.237467,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.36791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000640026,"duration_s":0.584803,"completed_at":"2026-08-11T10:49:20.051Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001723,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 157.464770] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"a7bf99dd7e316ef4592a104b","created_at":"2026-08-11T10:49:19.136Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"182bd322805b901025f3c5a890fd5a48","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T10:49:19.141Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-a7bf99dd7e316ef4592a104b: start","job_status":"start","queue_duration_s":0.912924,"scheduling_latency_s":0.912947}1329gitlab # [ 157.485536] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.067Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1330gitlab # [ 157.491135] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.075Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"a7bf99dd7e316ef4592a104b","created_at":"2026-08-11T10:49:19.136Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"182bd322805b901025f3c5a890fd5a48","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T10:49:19.141Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-a7bf99dd7e316ef4592a104b: done: 0.021074 sec","job_status":"done","queue_duration_s":0.912924,"scheduling_latency_s":0.912947,"redis_calls":10,"redis_duration_s":0.004534,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000923,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002564,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001047,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000518781,"duration_s":0.021074,"completed_at":"2026-08-11T10:49:20.075Z","load_balancing_strategy":"primary","db_duration_s":0.000815,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 157.493153] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.077Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d7d9cb4899d1b10780cf8adb","created_at":"2026-08-11T10:49:19.144Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e00f72141920f67b18aea634e2bc406b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.148Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d7d9cb4899d1b10780cf8adb: start","job_status":"start","queue_duration_s":0.928362,"scheduling_latency_s":0.928382}1332gitlab # [ 157.565266] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.139Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d7d9cb4899d1b10780cf8adb","created_at":"2026-08-11T10:49:19.144Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e00f72141920f67b18aea634e2bc406b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.148Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d7d9cb4899d1b10780cf8adb: done: 0.062383 sec","job_status":"done","queue_duration_s":0.928362,"scheduling_latency_s":0.928382,"redis_calls":16,"redis_duration_s":0.005784,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002133,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002479,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001172,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000396698,"duration_s":0.062383,"completed_at":"2026-08-11T10:49:20.139Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029029,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 157.571315] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.141Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9792495c90784a1e62f19aa7","created_at":"2026-08-11T10:49:19.162Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f8cc44fbff288be4eb46c88f62b473f8","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.171Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9792495c90784a1e62f19aa7: start","job_status":"start","queue_duration_s":0.970081,"scheduling_latency_s":0.970102}1334gitlab # [ 157.594042] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.164Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9792495c90784a1e62f19aa7","created_at":"2026-08-11T10:49:19.162Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f8cc44fbff288be4eb46c88f62b473f8","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.171Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9792495c90784a1e62f19aa7: done: 0.02294 sec","job_status":"done","queue_duration_s":0.970081,"scheduling_latency_s":0.970102,"redis_calls":12,"redis_duration_s":0.002892,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000439,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001293,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00116,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000840051,"exclusive_lock_hold_duration_s":0.004332114999999999,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.02294,"completed_at":"2026-08-11T10:49:20.164Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00179,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 157.676321] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.165Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"5d9b3ddead40a1c17a9f2e1b","created_at":"2026-08-11T10:49:19.174Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41545904c6aa1f96415af4f620c35ac1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.179Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-5d9b3ddead40a1c17a9f2e1b: start","job_status":"start","queue_duration_s":0.986011,"scheduling_latency_s":0.986034}1336gitlab # [ 157.742945] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.177Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1337gitlab # [ 157.743688] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"5d9b3ddead40a1c17a9f2e1b","created_at":"2026-08-11T10:49:19.174Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41545904c6aa1f96415af4f620c35ac1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.179Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-5d9b3ddead40a1c17a9f2e1b: done: 0.017695 sec","job_status":"done","queue_duration_s":0.986011,"scheduling_latency_s":0.986034,"redis_calls":10,"redis_duration_s":0.002288,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001399,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000409,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000380774,"duration_s":0.017695,"completed_at":"2026-08-11T10:49:20.183Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000389,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 157.811390] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"975d3a50c024d02f94468d4f","created_at":"2026-08-11T10:49:19.187Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3da889b7778144d536fc3e10c3c3a1ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.197Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-975d3a50c024d02f94468d4f: start","job_status":"start","queue_duration_s":1.132063,"scheduling_latency_s":1.132101}1339gitlab # [ 157.813608] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"975d3a50c024d02f94468d4f","created_at":"2026-08-11T10:49:19.187Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3da889b7778144d536fc3e10c3c3a1ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.197Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-975d3a50c024d02f94468d4f: done: 0.033317 sec","job_status":"done","queue_duration_s":1.132063,"scheduling_latency_s":1.132101,"redis_calls":19,"redis_duration_s":0.004215,"redis_read_bytes":21,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000856,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000292,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002361,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000706,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000374629,"duration_s":0.033317,"completed_at":"2026-08-11T10:49:20.362Z","load_balancing_strategy":"primary","db_duration_s":0.001857,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 157.900371] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ceb32cf3a90ee06577f08065","created_at":"2026-08-11T10:49:19.285Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b04e2955d11e1c548b9fe759145e90d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.320Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ceb32cf3a90ee06577f08065: start","job_status":"start","queue_duration_s":1.043412,"scheduling_latency_s":1.043432}1341gitlab # [ 157.901844] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.485Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ceb32cf3a90ee06577f08065","created_at":"2026-08-11T10:49:19.285Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b04e2955d11e1c548b9fe759145e90d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.320Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ceb32cf3a90ee06577f08065: done: 0.121265 sec","job_status":"done","queue_duration_s":1.043412,"scheduling_latency_s":1.043432,"redis_calls":12,"redis_duration_s":0.003119,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000494,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001383,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001242,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000712381,"exclusive_lock_hold_duration_s":0.005898516,"duration_s":0.121265,"completed_at":"2026-08-11T10:49:20.485Z","load_balancing_strategy":"primary","db_duration_s":0.002789,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 157.975866] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.487Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"7aa3c6d36310ed8f289647dd","created_at":"2026-08-11T10:49:19.343Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.365Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-7aa3c6d36310ed8f289647dd: start","job_status":"start","queue_duration_s":1.121767,"scheduling_latency_s":1.12179}1343gitlab # [ 157.977506] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"7aa3c6d36310ed8f289647dd","created_at":"2026-08-11T10:49:19.343Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.365Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-7aa3c6d36310ed8f289647dd: done: 0.095718 sec","job_status":"done","queue_duration_s":1.121767,"scheduling_latency_s":1.12179,"redis_calls":71,"redis_duration_s":0.015967,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002315,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000923,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.012114,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000615,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.075396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000361778,"duration_s":0.095718,"completed_at":"2026-08-11T10:49:20.582Z","load_balancing_strategy":"primary","db_duration_s":0.004047,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 158.062344] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.584Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c897e68113b63703f89cb91b","created_at":"2026-08-11T10:49:19.463Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e952a6218cb2d292ed70dcbbf175d45b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.494Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c897e68113b63703f89cb91b: start","job_status":"start","queue_duration_s":1.089394,"scheduling_latency_s":1.089416}1345gitlab # [ 158.063913] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.754Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c897e68113b63703f89cb91b","created_at":"2026-08-11T10:49:19.463Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-c05da9fe037e4fb6","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e952a6218cb2d292ed70dcbbf175d45b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T10:49:19.494Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c897e68113b63703f89cb91b: done: 0.170305 sec","job_status":"done","queue_duration_s":1.089394,"scheduling_latency_s":1.089416,"redis_calls":12,"redis_duration_s":0.003097,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000524,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001531,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.125693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000469333,"exclusive_lock_hold_duration_s":0.150562711,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.170305,"completed_at":"2026-08-11T10:49:20.754Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.051141,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 158.139469] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.756Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8b9883fc47cb834039c65325","created_at":"2026-08-11T10:49:20.346Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-36b74d47fea04b75","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3da889b7778144d536fc3e10c3c3a1ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.355Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8b9883fc47cb834039c65325: start","job_status":"start","queue_duration_s":0.401023,"scheduling_latency_s":0.401044}1347gitlab # [ 158.140914] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.771Z","message":"No existing merge request to be cleaned up."}1348gitlab # [ 158.142050] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.782Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8b9883fc47cb834039c65325","created_at":"2026-08-11T10:49:20.346Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-36b74d47fea04b75","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3da889b7778144d536fc3e10c3c3a1ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.355Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8b9883fc47cb834039c65325: done: 0.025661 sec","job_status":"done","queue_duration_s":0.401023,"scheduling_latency_s":0.401044,"redis_calls":13,"redis_duration_s":0.003109,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000481,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015702,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000341385,"duration_s":0.025661,"completed_at":"2026-08-11T10:49:20.782Z","load_balancing_strategy":"primary","db_duration_s":0.003055,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 158.220149] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.783Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"df9c84ce08e738e51c59f2b5","created_at":"2026-08-11T10:49:20.346Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-36b74d47fea04b75","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3da889b7778144d536fc3e10c3c3a1ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.355Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-df9c84ce08e738e51c59f2b5: start","job_status":"start","queue_duration_s":0.428158,"scheduling_latency_s":0.428179}1350gitlab # [ 158.221399] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.793Z","message":"No existing merge request to be cleaned up."}1351gitlab # [ 158.222291] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.800Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"df9c84ce08e738e51c59f2b5","created_at":"2026-08-11T10:49:20.346Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-36b74d47fea04b75","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3da889b7778144d536fc3e10c3c3a1ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.355Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-df9c84ce08e738e51c59f2b5: done: 0.01653 sec","job_status":"done","queue_duration_s":0.428158,"scheduling_latency_s":0.428179,"redis_calls":10,"redis_duration_s":0.002164,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000831,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001333,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01653,"completed_at":"2026-08-11T10:49:20.800Z","load_balancing_strategy":"primary","db_duration_s":0.001505,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 158.303060] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.801Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"24085a3a301de00233a8846d","created_at":"2026-08-11T10:49:20.346Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-36b74d47fea04b75","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3da889b7778144d536fc3e10c3c3a1ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.355Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-24085a3a301de00233a8846d: start","job_status":"start","queue_duration_s":0.445942,"scheduling_latency_s":0.445963}1353gitlab # [ 158.304286] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.811Z","message":"No existing merge request to be cleaned up."}1354gitlab # [ 158.305266] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.817Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"24085a3a301de00233a8846d","created_at":"2026-08-11T10:49:20.346Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-36b74d47fea04b75","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3da889b7778144d536fc3e10c3c3a1ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.355Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-24085a3a301de00233a8846d: done: 0.016422 sec","job_status":"done","queue_duration_s":0.445942,"scheduling_latency_s":0.445963,"redis_calls":10,"redis_duration_s":0.00219,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000825,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001365,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016422,"completed_at":"2026-08-11T10:49:20.817Z","load_balancing_strategy":"primary","db_duration_s":0.001489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 158.393577] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.819Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c4fec925cf7fed5f1d6b2dcd","created_at":"2026-08-11T10:49:20.346Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-36b74d47fea04b75","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3da889b7778144d536fc3e10c3c3a1ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.355Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c4fec925cf7fed5f1d6b2dcd: start","job_status":"start","queue_duration_s":0.463643,"scheduling_latency_s":0.463664}1356gitlab # [ 158.394681] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.829Z","message":"No existing merge request to be cleaned up."}1357gitlab # [ 158.395847] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.835Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c4fec925cf7fed5f1d6b2dcd","created_at":"2026-08-11T10:49:20.346Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-36b74d47fea04b75","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3da889b7778144d536fc3e10c3c3a1ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.355Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c4fec925cf7fed5f1d6b2dcd: done: 0.016541 sec","job_status":"done","queue_duration_s":0.463643,"scheduling_latency_s":0.463664,"redis_calls":10,"redis_duration_s":0.002414,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001499,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016541,"completed_at":"2026-08-11T10:49:20.835Z","load_balancing_strategy":"primary","db_duration_s":0.001458,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 158.422159] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8596a05582b771df877a38c","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8596a05582b771df877a38c: start","job_status":"start","queue_duration_s":0.262947,"scheduling_latency_s":0.262968}1359gitlab # [ 158.492853] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8596a05582b771df877a38c","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8596a05582b771df877a38c: done: 0.021494 sec","job_status":"done","queue_duration_s":0.262947,"scheduling_latency_s":0.262968,"redis_calls":16,"redis_duration_s":0.0034679999999999997,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000445,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001078,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001945,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000518223,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021494,"completed_at":"2026-08-11T10:49:20.858Z","load_balancing_strategy":"primary","db_duration_s":0.000367,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 158.503873] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1703aacbda08c6e14d4b0117","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1703aacbda08c6e14d4b0117: start","job_status":"start","queue_duration_s":0.285895,"scheduling_latency_s":0.285915}1361gitlab # [ 158.570217] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1703aacbda08c6e14d4b0117","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1703aacbda08c6e14d4b0117: done: 0.015641 sec","job_status":"done","queue_duration_s":0.285895,"scheduling_latency_s":0.285915,"redis_calls":13,"redis_duration_s":0.002727,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001872,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015641,"completed_at":"2026-08-11T10:49:20.875Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 158.582391] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d990abfe52cddae47c3c027","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d990abfe52cddae47c3c027: start","job_status":"start","queue_duration_s":0.302967,"scheduling_latency_s":0.302987}1363gitlab # [ 158.663866] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d990abfe52cddae47c3c027","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d990abfe52cddae47c3c027: done: 0.015817 sec","job_status":"done","queue_duration_s":0.302967,"scheduling_latency_s":0.302987,"redis_calls":13,"redis_duration_s":0.0030559999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002068,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015817,"completed_at":"2026-08-11T10:49:20.892Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 158.666087] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2168fe4db086822598776d44","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2168fe4db086822598776d44: start","job_status":"start","queue_duration_s":0.320199,"scheduling_latency_s":0.32022}1365gitlab # [ 158.733142] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2168fe4db086822598776d44","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2168fe4db086822598776d44: done: 0.015772 sec","job_status":"done","queue_duration_s":0.320199,"scheduling_latency_s":0.32022,"redis_calls":13,"redis_duration_s":0.002737,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000821,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015772,"completed_at":"2026-08-11T10:49:20.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 158.803048] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1af26dd0db5a9e27008a126","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1af26dd0db5a9e27008a126: start","job_status":"start","queue_duration_s":0.337568,"scheduling_latency_s":0.337589}1367gitlab # [ 158.804178] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1af26dd0db5a9e27008a126","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1af26dd0db5a9e27008a126: done: 0.015779 sec","job_status":"done","queue_duration_s":0.337568,"scheduling_latency_s":0.337589,"redis_calls":13,"redis_duration_s":0.0029360000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015779,"completed_at":"2026-08-11T10:49:20.927Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 158.819120] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b34ee139f8e29ba71e3496e","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b34ee139f8e29ba71e3496e: start","job_status":"start","queue_duration_s":0.354716,"scheduling_latency_s":0.354737}1369gitlab # [ 158.893432] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b34ee139f8e29ba71e3496e","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b34ee139f8e29ba71e3496e: done: 0.015463 sec","job_status":"done","queue_duration_s":0.354716,"scheduling_latency_s":0.354737,"redis_calls":13,"redis_duration_s":0.002754,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001854,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015463,"completed_at":"2026-08-11T10:49:20.944Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 158.897901] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcf3184b1cfedab33d4f53be","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcf3184b1cfedab33d4f53be: start","job_status":"start","queue_duration_s":0.371501,"scheduling_latency_s":0.37152}1371gitlab # [ 158.966182] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcf3184b1cfedab33d4f53be","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcf3184b1cfedab33d4f53be: done: 0.015563 sec","job_status":"done","queue_duration_s":0.371501,"scheduling_latency_s":0.37152,"redis_calls":13,"redis_duration_s":0.002678,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000859,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001819,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015563,"completed_at":"2026-08-11T10:49:20.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 159.036093] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e8104ed6841eb748ad24f6f","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e8104ed6841eb748ad24f6f: start","job_status":"start","queue_duration_s":0.388318,"scheduling_latency_s":0.388383}1373gitlab # [ 159.037266] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e8104ed6841eb748ad24f6f","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e8104ed6841eb748ad24f6f: done: 0.01542 sec","job_status":"done","queue_duration_s":0.388318,"scheduling_latency_s":0.388383,"redis_calls":13,"redis_duration_s":0.002731,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01542,"completed_at":"2026-08-11T10:49:20.977Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 159.116107] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e3bf188eb37abb2de3f82fb","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e3bf188eb37abb2de3f82fb: start","job_status":"start","queue_duration_s":0.405155,"scheduling_latency_s":0.405176}1375gitlab # [ 159.117417] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e3bf188eb37abb2de3f82fb","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e3bf188eb37abb2de3f82fb: done: 0.015741 sec","job_status":"done","queue_duration_s":0.405155,"scheduling_latency_s":0.405176,"redis_calls":13,"redis_duration_s":0.00281,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015741,"completed_at":"2026-08-11T10:49:20.994Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 159.186270] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:20.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d83021943a956747ba4a28f","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d83021943a956747ba4a28f: start","job_status":"start","queue_duration_s":0.422418,"scheduling_latency_s":0.42244}1377gitlab # [ 159.187438] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d83021943a956747ba4a28f","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d83021943a956747ba4a28f: done: 0.015832 sec","job_status":"done","queue_duration_s":0.422418,"scheduling_latency_s":0.42244,"redis_calls":13,"redis_duration_s":0.0029569999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015832,"completed_at":"2026-08-11T10:49:21.012Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 159.212376] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"181bad621055af63500f0329","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-181bad621055af63500f0329: start","job_status":"start","queue_duration_s":0.439577,"scheduling_latency_s":0.439598}1379gitlab # [ 159.281080] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"181bad621055af63500f0329","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-181bad621055af63500f0329: done: 0.015589 sec","job_status":"done","queue_duration_s":0.439577,"scheduling_latency_s":0.439598,"redis_calls":13,"redis_duration_s":0.002993,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001074,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010401,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015589,"completed_at":"2026-08-11T10:49:21.029Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 159.350122] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bc08ba1053436619c9e4b45","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bc08ba1053436619c9e4b45: start","job_status":"start","queue_duration_s":0.456708,"scheduling_latency_s":0.456728}1381gitlab # [ 159.351395] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bc08ba1053436619c9e4b45","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bc08ba1053436619c9e4b45: done: 0.015494 sec","job_status":"done","queue_duration_s":0.456708,"scheduling_latency_s":0.456728,"redis_calls":13,"redis_duration_s":0.002788,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015494,"completed_at":"2026-08-11T10:49:21.046Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 159.431586] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"813ba388af6998d494cfac90","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-813ba388af6998d494cfac90: start","job_status":"start","queue_duration_s":0.473677,"scheduling_latency_s":0.473697}1383gitlab # [ 159.433162] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"813ba388af6998d494cfac90","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-813ba388af6998d494cfac90: done: 0.015356 sec","job_status":"done","queue_duration_s":0.473677,"scheduling_latency_s":0.473697,"redis_calls":13,"redis_duration_s":0.002699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001815,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015356,"completed_at":"2026-08-11T10:49:21.063Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 159.500082] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5cdbc18c047593480725dd2","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5cdbc18c047593480725dd2: start","job_status":"start","queue_duration_s":0.490483,"scheduling_latency_s":0.490504}1385gitlab # [ 159.501449] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5cdbc18c047593480725dd2","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5cdbc18c047593480725dd2: done: 0.064328 sec","job_status":"done","queue_duration_s":0.490483,"scheduling_latency_s":0.490504,"redis_calls":13,"redis_duration_s":0.0031019999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001014,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.064328,"completed_at":"2026-08-11T10:49:21.128Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 159.573118] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22ce510188922115c8efe190","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22ce510188922115c8efe190: start","job_status":"start","queue_duration_s":0.556223,"scheduling_latency_s":0.556248}1387gitlab # [ 159.574264] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22ce510188922115c8efe190","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22ce510188922115c8efe190: done: 0.015729 sec","job_status":"done","queue_duration_s":0.556223,"scheduling_latency_s":0.556248,"redis_calls":13,"redis_duration_s":0.002894,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015729,"completed_at":"2026-08-11T10:49:21.146Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 159.644941] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"290e9c81b782571d78c3e10a","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-290e9c81b782571d78c3e10a: start","job_status":"start","queue_duration_s":0.573206,"scheduling_latency_s":0.573228}1389gitlab # [ 159.645986] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"290e9c81b782571d78c3e10a","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-290e9c81b782571d78c3e10a: done: 0.015342 sec","job_status":"done","queue_duration_s":0.573206,"scheduling_latency_s":0.573228,"redis_calls":13,"redis_duration_s":0.002627,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001772,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015342,"completed_at":"2026-08-11T10:49:21.162Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 159.733439] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56037709eb847e97b4cc3992","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56037709eb847e97b4cc3992: start","job_status":"start","queue_duration_s":0.589824,"scheduling_latency_s":0.589845}1391gitlab # [ 159.734990] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56037709eb847e97b4cc3992","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56037709eb847e97b4cc3992: done: 0.018245 sec","job_status":"done","queue_duration_s":0.589824,"scheduling_latency_s":0.589845,"redis_calls":13,"redis_duration_s":0.00362,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002555,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018245,"completed_at":"2026-08-11T10:49:21.182Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 159.805144] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90b763e39c417cb802eae9bb","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90b763e39c417cb802eae9bb: start","job_status":"start","queue_duration_s":0.609651,"scheduling_latency_s":0.609676}1393gitlab # [ 159.806316] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90b763e39c417cb802eae9bb","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90b763e39c417cb802eae9bb: done: 0.015967 sec","job_status":"done","queue_duration_s":0.609651,"scheduling_latency_s":0.609676,"redis_calls":13,"redis_duration_s":0.002967,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000993,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015967,"completed_at":"2026-08-11T10:49:21.199Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 159.881318] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7ad04ba3e38f48dd911f312","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7ad04ba3e38f48dd911f312: start","job_status":"start","queue_duration_s":0.626899,"scheduling_latency_s":0.62692}1395gitlab # [ 159.882377] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7ad04ba3e38f48dd911f312","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7ad04ba3e38f48dd911f312: done: 0.015156 sec","job_status":"done","queue_duration_s":0.626899,"scheduling_latency_s":0.62692,"redis_calls":13,"redis_duration_s":0.0026420000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001797,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015156,"completed_at":"2026-08-11T10:49:21.216Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 159.950996] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"852a9db25ffc2bc1f439fa3a","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-852a9db25ffc2bc1f439fa3a: start","job_status":"start","queue_duration_s":0.643795,"scheduling_latency_s":0.643826}1397gitlab # [ 159.952363] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.232Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"852a9db25ffc2bc1f439fa3a","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-852a9db25ffc2bc1f439fa3a: done: 0.01504 sec","job_status":"done","queue_duration_s":0.643795,"scheduling_latency_s":0.643826,"redis_calls":13,"redis_duration_s":0.00264,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001761,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01504,"completed_at":"2026-08-11T10:49:21.232Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 160.020061] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d247a926c95810105b2aec8","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d247a926c95810105b2aec8: start","job_status":"start","queue_duration_s":0.660127,"scheduling_latency_s":0.660147}1399gitlab # [ 160.021312] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d247a926c95810105b2aec8","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d247a926c95810105b2aec8: done: 0.015423 sec","job_status":"done","queue_duration_s":0.660127,"scheduling_latency_s":0.660147,"redis_calls":13,"redis_duration_s":0.003193,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000814,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002379,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015423,"completed_at":"2026-08-11T10:49:21.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 160.098791] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8d305828b3ffd6087b5a3d3","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8d305828b3ffd6087b5a3d3: start","job_status":"start","queue_duration_s":0.676809,"scheduling_latency_s":0.676839}1401gitlab # [ 160.099915] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8d305828b3ffd6087b5a3d3","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8d305828b3ffd6087b5a3d3: done: 0.015363 sec","job_status":"done","queue_duration_s":0.676809,"scheduling_latency_s":0.676839,"redis_calls":13,"redis_duration_s":0.0030139999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015363,"completed_at":"2026-08-11T10:49:21.266Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 160.167881] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d709a23748d42078a9588fe9","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d709a23748d42078a9588fe9: start","job_status":"start","queue_duration_s":0.693548,"scheduling_latency_s":0.693568}1403gitlab # [ 160.178318] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d709a23748d42078a9588fe9","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d709a23748d42078a9588fe9: done: 0.015391 sec","job_status":"done","queue_duration_s":0.693548,"scheduling_latency_s":0.693568,"redis_calls":13,"redis_duration_s":0.002958,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00201,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015391,"completed_at":"2026-08-11T10:49:21.283Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 160.257170] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a522f46fea22211b6b996bd7","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a522f46fea22211b6b996bd7: start","job_status":"start","queue_duration_s":0.710657,"scheduling_latency_s":0.710677}1405gitlab # [ 160.258464] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a522f46fea22211b6b996bd7","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a522f46fea22211b6b996bd7: done: 0.015177 sec","job_status":"done","queue_duration_s":0.710657,"scheduling_latency_s":0.710677,"redis_calls":13,"redis_duration_s":0.002744,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001837,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015177,"completed_at":"2026-08-11T10:49:21.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 160.340884] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9c6c05f2165ad2333679fa2","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9c6c05f2165ad2333679fa2: start","job_status":"start","queue_duration_s":0.7271,"scheduling_latency_s":0.72712}1407gitlab # [ 160.342239] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9c6c05f2165ad2333679fa2","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9c6c05f2165ad2333679fa2: done: 0.015021 sec","job_status":"done","queue_duration_s":0.7271,"scheduling_latency_s":0.72712,"redis_calls":13,"redis_duration_s":0.002712,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001833,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015021,"completed_at":"2026-08-11T10:49:21.316Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 160.410940] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1386e4e3752b6244ffa5cdc1","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1386e4e3752b6244ffa5cdc1: start","job_status":"start","queue_duration_s":0.743445,"scheduling_latency_s":0.743467}1409gitlab # [ 160.415777] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1386e4e3752b6244ffa5cdc1","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1386e4e3752b6244ffa5cdc1: done: 0.015235 sec","job_status":"done","queue_duration_s":0.743445,"scheduling_latency_s":0.743467,"redis_calls":13,"redis_duration_s":0.0027069999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00086,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001847,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015235,"completed_at":"2026-08-11T10:49:21.332Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 160.524458] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0c7544b631249a47fe5e4d0","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0c7544b631249a47fe5e4d0: start","job_status":"start","queue_duration_s":0.760031,"scheduling_latency_s":0.760053}1411gitlab # [ 160.525951] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0c7544b631249a47fe5e4d0","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0c7544b631249a47fe5e4d0: done: 0.01587 sec","job_status":"done","queue_duration_s":0.760031,"scheduling_latency_s":0.760053,"redis_calls":13,"redis_duration_s":0.003125,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000887,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002238,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01587,"completed_at":"2026-08-11T10:49:21.349Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 160.600320] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f2a60feb36aa55f0685a61f","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f2a60feb36aa55f0685a61f: start","job_status":"start","queue_duration_s":0.777939,"scheduling_latency_s":0.777978}1413gitlab # [ 160.602169] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f2a60feb36aa55f0685a61f","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f2a60feb36aa55f0685a61f: done: 0.018312 sec","job_status":"done","queue_duration_s":0.777939,"scheduling_latency_s":0.777978,"redis_calls":13,"redis_duration_s":0.0027660000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018312,"completed_at":"2026-08-11T10:49:21.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 160.639769] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff395d73c4855bb7aa828e7d","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff395d73c4855bb7aa828e7d: start","job_status":"start","queue_duration_s":0.797505,"scheduling_latency_s":0.797526}1415gitlab # [ 160.707383] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff395d73c4855bb7aa828e7d","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff395d73c4855bb7aa828e7d: done: 0.015088 sec","job_status":"done","queue_duration_s":0.797505,"scheduling_latency_s":0.797526,"redis_calls":13,"redis_duration_s":0.00266,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001842,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015088,"completed_at":"2026-08-11T10:49:21.386Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 160.718727] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9aa439e9ae15be164b80355","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9aa439e9ae15be164b80355: start","job_status":"start","queue_duration_s":0.813858,"scheduling_latency_s":0.813879}1417gitlab # [ 160.788885] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9aa439e9ae15be164b80355","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9aa439e9ae15be164b80355: done: 0.015207 sec","job_status":"done","queue_duration_s":0.813858,"scheduling_latency_s":0.813879,"redis_calls":13,"redis_duration_s":0.002772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00191,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015207,"completed_at":"2026-08-11T10:49:21.403Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 160.859197] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bb2132ec2f922bfef282c94","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bb2132ec2f922bfef282c94: start","job_status":"start","queue_duration_s":0.830724,"scheduling_latency_s":0.830745}1419gitlab # [ 160.860495] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.419Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bb2132ec2f922bfef282c94","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bb2132ec2f922bfef282c94: done: 0.015175 sec","job_status":"done","queue_duration_s":0.830724,"scheduling_latency_s":0.830745,"redis_calls":13,"redis_duration_s":0.002715,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001857,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015175,"completed_at":"2026-08-11T10:49:21.419Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 160.936305] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02c125a1a8a1dde6283efd58","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02c125a1a8a1dde6283efd58: start","job_status":"start","queue_duration_s":0.847152,"scheduling_latency_s":0.847172}1421gitlab # [ 160.937365] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02c125a1a8a1dde6283efd58","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02c125a1a8a1dde6283efd58: done: 0.015194 sec","job_status":"done","queue_duration_s":0.847152,"scheduling_latency_s":0.847172,"redis_calls":13,"redis_duration_s":0.002744,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000886,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001858,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015194,"completed_at":"2026-08-11T10:49:21.436Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 161.009391] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cae993e5b1ceab4ceea1cb7","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cae993e5b1ceab4ceea1cb7: start","job_status":"start","queue_duration_s":0.863643,"scheduling_latency_s":0.863664}1423gitlab # [ 161.011313] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cae993e5b1ceab4ceea1cb7","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cae993e5b1ceab4ceea1cb7: done: 0.015072 sec","job_status":"done","queue_duration_s":0.863643,"scheduling_latency_s":0.863664,"redis_calls":13,"redis_duration_s":0.002711,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001849,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015072,"completed_at":"2026-08-11T10:49:21.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 161.099491] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"309966ac60c185936be34d14","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-309966ac60c185936be34d14: start","job_status":"start","queue_duration_s":0.879989,"scheduling_latency_s":0.880009}1425gitlab # [ 161.101609] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"309966ac60c185936be34d14","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-309966ac60c185936be34d14: done: 0.015258 sec","job_status":"done","queue_duration_s":0.879989,"scheduling_latency_s":0.880009,"redis_calls":13,"redis_duration_s":0.002672,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000856,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001816,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015258,"completed_at":"2026-08-11T10:49:21.469Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 161.114670] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6b9e58448fdc7affadb9fce","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6b9e58448fdc7affadb9fce: start","job_status":"start","queue_duration_s":0.896558,"scheduling_latency_s":0.896578}1427gitlab # [ 161.196595] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6b9e58448fdc7affadb9fce","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6b9e58448fdc7affadb9fce: done: 0.015004 sec","job_status":"done","queue_duration_s":0.896558,"scheduling_latency_s":0.896578,"redis_calls":13,"redis_duration_s":0.0027080000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015004,"completed_at":"2026-08-11T10:49:21.485Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 161.199241] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1fa211d9b555a527edd4dca3","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1fa211d9b555a527edd4dca3: start","job_status":"start","queue_duration_s":0.912941,"scheduling_latency_s":0.912962}1429gitlab # [ 161.215494] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1fa211d9b555a527edd4dca3","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1fa211d9b555a527edd4dca3: done: 0.015436 sec","job_status":"done","queue_duration_s":0.912941,"scheduling_latency_s":0.912962,"redis_calls":13,"redis_duration_s":0.002961,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015436,"completed_at":"2026-08-11T10:49:21.502Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 161.293441] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d448c8c81aecf751f801b7b","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d448c8c81aecf751f801b7b: start","job_status":"start","queue_duration_s":0.929753,"scheduling_latency_s":0.929774}1431gitlab # [ 161.295321] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d448c8c81aecf751f801b7b","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d448c8c81aecf751f801b7b: done: 0.015298 sec","job_status":"done","queue_duration_s":0.929753,"scheduling_latency_s":0.929774,"redis_calls":13,"redis_duration_s":0.002913,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015298,"completed_at":"2026-08-11T10:49:21.519Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 161.410509] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.520Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c53722225e3ff2b7dcc5602","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c53722225e3ff2b7dcc5602: start","job_status":"start","queue_duration_s":0.946716,"scheduling_latency_s":0.946736}1433gitlab # [ 161.412241] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c53722225e3ff2b7dcc5602","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c53722225e3ff2b7dcc5602: done: 0.015066 sec","job_status":"done","queue_duration_s":0.946716,"scheduling_latency_s":0.946736,"redis_calls":13,"redis_duration_s":0.002732,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000847,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015066,"completed_at":"2026-08-11T10:49:21.535Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 161.439451] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93196f0d0bcd35e067b8ff9e","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93196f0d0bcd35e067b8ff9e: start","job_status":"start","queue_duration_s":0.963056,"scheduling_latency_s":0.963076}1435gitlab # [ 161.523610] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93196f0d0bcd35e067b8ff9e","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93196f0d0bcd35e067b8ff9e: done: 0.015482 sec","job_status":"done","queue_duration_s":0.963056,"scheduling_latency_s":0.963076,"redis_calls":13,"redis_duration_s":0.0034230000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002543,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015482,"completed_at":"2026-08-11T10:49:21.552Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 161.526972] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93ae7d9d2d75136d24520cd4","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93ae7d9d2d75136d24520cd4: start","job_status":"start","queue_duration_s":0.979802,"scheduling_latency_s":0.979832}1437gitlab # [ 161.539631] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93ae7d9d2d75136d24520cd4","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93ae7d9d2d75136d24520cd4: done: 0.015232 sec","job_status":"done","queue_duration_s":0.979802,"scheduling_latency_s":0.979832,"redis_calls":13,"redis_duration_s":0.002692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001862,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015232,"completed_at":"2026-08-11T10:49:21.569Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 161.629969] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92e6ca4ee52fcdc4c3e0c96b","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92e6ca4ee52fcdc4c3e0c96b: start","job_status":"start","queue_duration_s":0.996306,"scheduling_latency_s":0.996326}1439gitlab # [ 161.631186] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92e6ca4ee52fcdc4c3e0c96b","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92e6ca4ee52fcdc4c3e0c96b: done: 0.015455 sec","job_status":"done","queue_duration_s":0.996306,"scheduling_latency_s":0.996326,"redis_calls":13,"redis_duration_s":0.0027790000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015455,"completed_at":"2026-08-11T10:49:21.585Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 161.716963] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83dcacf65b19c4159852d4aa","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83dcacf65b19c4159852d4aa: start","job_status":"start","queue_duration_s":1.013687,"scheduling_latency_s":1.013708}1441gitlab # [ 161.718384] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83dcacf65b19c4159852d4aa","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83dcacf65b19c4159852d4aa: done: 0.015331 sec","job_status":"done","queue_duration_s":1.013687,"scheduling_latency_s":1.013708,"redis_calls":13,"redis_duration_s":0.002718,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000856,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001862,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015331,"completed_at":"2026-08-11T10:49:21.603Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 161.788156] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a96be39276fdf0257fee7bc2","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a96be39276fdf0257fee7bc2: start","job_status":"start","queue_duration_s":1.030285,"scheduling_latency_s":1.030305}1443gitlab # [ 161.789443] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a96be39276fdf0257fee7bc2","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a96be39276fdf0257fee7bc2: done: 0.01502 sec","job_status":"done","queue_duration_s":1.030285,"scheduling_latency_s":1.030305,"redis_calls":13,"redis_duration_s":0.002648,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000852,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001796,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01502,"completed_at":"2026-08-11T10:49:21.619Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 161.883178] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73b04ca6087953e8dcef5109","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73b04ca6087953e8dcef5109: start","job_status":"start","queue_duration_s":1.046712,"scheduling_latency_s":1.046733}1445gitlab # [ 161.884523] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73b04ca6087953e8dcef5109","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73b04ca6087953e8dcef5109: done: 0.015046 sec","job_status":"done","queue_duration_s":1.046712,"scheduling_latency_s":1.046733,"redis_calls":13,"redis_duration_s":0.002777,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000859,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015046,"completed_at":"2026-08-11T10:49:21.635Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 161.960168] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.637Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"657712dd78a099a53c6b1773","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-657712dd78a099a53c6b1773: start","job_status":"start","queue_duration_s":1.063036,"scheduling_latency_s":1.063056}1447gitlab # [ 161.961464] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"657712dd78a099a53c6b1773","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-657712dd78a099a53c6b1773: done: 0.01533 sec","job_status":"done","queue_duration_s":1.063036,"scheduling_latency_s":1.063056,"redis_calls":13,"redis_duration_s":0.0030269999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002159,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01533,"completed_at":"2026-08-11T10:49:21.652Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 162.034938] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19fe2c69d9bb832d77790225","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19fe2c69d9bb832d77790225: start","job_status":"start","queue_duration_s":1.080048,"scheduling_latency_s":1.08007}1449gitlab # [ 162.036328] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19fe2c69d9bb832d77790225","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19fe2c69d9bb832d77790225: done: 0.015529 sec","job_status":"done","queue_duration_s":1.080048,"scheduling_latency_s":1.08007,"redis_calls":13,"redis_duration_s":0.002776,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001866,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015529,"completed_at":"2026-08-11T10:49:21.669Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 162.103890] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8d8768d2e2f9d620e52b176","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8d8768d2e2f9d620e52b176: start","job_status":"start","queue_duration_s":1.096831,"scheduling_latency_s":1.096853}1451gitlab # [ 162.104698] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8d8768d2e2f9d620e52b176","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8d8768d2e2f9d620e52b176: done: 0.01507 sec","job_status":"done","queue_duration_s":1.096831,"scheduling_latency_s":1.096853,"redis_calls":13,"redis_duration_s":0.002718,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000853,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001865,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01507,"completed_at":"2026-08-11T10:49:21.685Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 162.179130] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3611c614c0a5061d174c999","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3611c614c0a5061d174c999: start","job_status":"start","queue_duration_s":1.113142,"scheduling_latency_s":1.113162}1453gitlab # [ 162.180316] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3611c614c0a5061d174c999","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3611c614c0a5061d174c999: done: 0.015001 sec","job_status":"done","queue_duration_s":1.113142,"scheduling_latency_s":1.113162,"redis_calls":13,"redis_duration_s":0.002719,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015001,"completed_at":"2026-08-11T10:49:21.702Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 162.252350] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.703Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"673acfdc8281eb50c0a546ad","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-673acfdc8281eb50c0a546ad: start","job_status":"start","queue_duration_s":1.129441,"scheduling_latency_s":1.129462}1455gitlab # [ 162.253423] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"673acfdc8281eb50c0a546ad","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-673acfdc8281eb50c0a546ad: done: 0.015035 sec","job_status":"done","queue_duration_s":1.129441,"scheduling_latency_s":1.129462,"redis_calls":13,"redis_duration_s":0.002618,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001813,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015035,"completed_at":"2026-08-11T10:49:21.718Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 162.322781] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f89951c52a5f1594180fdce9","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f89951c52a5f1594180fdce9: start","job_status":"start","queue_duration_s":1.14607,"scheduling_latency_s":1.14609}1457gitlab # [ 162.328371] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:21.735Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f89951c52a5f1594180fdce9","created_at":"2026-08-11T10:49:20.509Z","trace_propagation_headers":{"sentry-trace":"1dabcc0ebdbe4c5eb0c40e1426f742fc-d4c07e6b38ed4871","baggage":"sentry-trace_id=1dabcc0ebdbe4c5eb0c40e1426f742fc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c3f34a6294e2de9f10ff669a7dfca8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:49:20.574Z","job_size_bytes":2,"pid":1686,"sidekiq_tid":"maiq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f89951c52a5f1594180fdce9: done: 0.015353 sec","job_status":"done","queue_duration_s":1.14607,"scheduling_latency_s":1.14609,"redis_calls":13,"redis_duration_s":0.002952,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002076,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015353,"completed_at":"2026-08-11T10:49:21.735Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 162.723490] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 4165025899 wd_nsec: 41650244011459gitlab # [ 170.010408] setup-gitlab-start[2268]: W, [2026-08-11T10:49:32.700882 #2268] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1460gitlab # [ 192.924254] postgres[2481]: [2481] ERROR: relation "table_without_models" does not exist1461gitlab # [ 192.927722] postgres[2481]: [2481] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1462gitlab # [ 196.097371] runuser[2267]: pam_unix(runuser:session): session closed for user gitlab1463gitlab # [ 196.100323] setup-gitlab-start[2238]: + systemctl restart gitlab-sidekiq.service1464gitlab # [ 196.122878] systemd[1]: Stopping gitlab-sidekiq.service...1465gitlab # [ 196.124753] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:58.814Z","message":"Shutting down"}1466gitlab # [ 196.127170] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:58.814Z","message":"Scheduler exiting..."}1467gitlab # [ 196.129582] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:58.814Z","message":"Terminating quiet threads for default capsule"}1468gitlab # [ 196.132362] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:58.815Z","message":"Scheduler exiting..."}1469gitlab # [ 196.626995] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:49:59.317Z","message":"Pausing to allow jobs to finish..."}1470gitlab # [ 199.636288] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:50:02.326Z","message":"Bye!"}1471gitlab # [ 199.671455] sidekiq-cluster[1686]: {"severity":"INFO","time":"2026-08-11T10:50:02.362Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1686,"worker_id":"sidekiq_0","memwd_rss_bytes":942575616,"retry":0}1472gitlab # [ 200.026306] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1473gitlab # [ 200.030752] systemd[1]: Stopped gitlab-sidekiq.service.1474gitlab # [ 200.034364] systemd[1]: gitlab-sidekiq.service: Consumed 1min 890ms CPU time over 1min 58.389s wall clock time, 955.3M memory peak, 4.4M read from disk.1475gitlab # [ 200.042770] systemd[1]: Started gitlab-sidekiq.service.1476gitlab # [ 200.047858] setup-gitlab-start[2238]: + mkdir -p /var/lib/secrets1477gitlab # [ 200.051663] setup-gitlab-start[2238]: + echo nixbot-test-token-of-20-chars1478gitlab # [ 200.055843] setup-gitlab-start[2238]: + chmod 644 /var/lib/secrets/gitlab-token1479gitlab # [ 200.060275] setup-gitlab-start[2238]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1480gitlab # [ 200.786496] gitaly[924]: time="2026-08-11T10:50:03.477Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:50:13.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.476" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1481gitlab # [ 200.821821] gitaly[924]: time="2026-08-11T10:50:03.513Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:50:13.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.476" grpc.time_ms=0.665 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1482gitlab # [ 200.985559] gitaly[924]: time="2026-08-11T10:50:03.676Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:50:13.205" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.676" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1483gitlab # [ 201.027163] gitaly[924]: time="2026-08-11T10:50:03.677Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:50:13.205" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.676" grpc.time_ms=0.543 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1484gitlab # [ 201.059110] gitaly[924]: time="2026-08-11T10:50:03.735Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG diskcache=b8b21100-3597-4c8b-96c6-44b3772880d2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T10:50:13.214" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.685" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1485gitlab # [ 201.075091] gitaly[924]: time="2026-08-11T10:50:03.739Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1575 command.oublock=32 command.real_time_ms=16 command.spawn_token_fork_ms=7 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T10:50:13.214" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.685" grpc.time_ms=53.839 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1486gitlab # [ 201.096077] gitaly[924]: time="2026-08-11T10:50:03.751Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:50:13.280" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.751" pid=924 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1487gitlab # [ 201.112246] gitaly[924]: time="2026-08-11T10:50:03.752Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:50:13.280" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.751" grpc.time_ms=0.92 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1488gitlab # [ 201.129367] gitaly[924]: time="2026-08-11T10:50:03.806Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=48 command.spawn_token_fork_ms=44 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:50:13.285" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.755" grpc.time_ms=50.619 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1489gitlab # [ 201.182688] gitaly[924]: time="2026-08-11T10:50:03.873Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:50:13.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.873" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1490gitlab # [ 201.184703] gitaly[924]: time="2026-08-11T10:50:03.874Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:50:13.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.873" grpc.time_ms=0.238 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1491gitlab # [ 201.234146] gitaly[924]: time="2026-08-11T10:50:03.925Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG diskcache=4183160c-1b09-4b17-9ae0-39fedca749ff grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T10:50:13.009" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.880" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1492gitlab # [ 201.250337] gitaly[924]: time="2026-08-11T10:50:03.925Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1572 command.oublock=32 command.real_time_ms=17 command.spawn_token_fork_ms=8 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T10:50:13.009" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.880" grpc.time_ms=44.937 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1493gitlab # [ 201.251433] gitaly[924]: time="2026-08-11T10:50:03.934Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:50:13.062" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.933" pid=924 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1494gitlab # [ 201.252211] gitaly[924]: time="2026-08-11T10:50:03.934Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:50:13.062" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.933" grpc.time_ms=1.302 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1495gitlab # [ 201.259901] gitaly[924]: time="2026-08-11T10:50:03.951Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:50:13.069" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.940" grpc.time_ms=10.875 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1496gitlab # [ 201.288110] gitaly[924]: time="2026-08-11T10:50:03.979Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:50:13.108" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.978" grpc.time_ms=0.254 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1497gitlab # [ 201.295064] gitaly[924]: time="2026-08-11T10:50:03.986Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T10:50:13.115" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:03.985" grpc.time_ms=0.316 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1498gitlab # [ 201.860163] gitaly[924]: time="2026-08-11T10:50:04.550Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR734M5VM4N2ACSKNCBNVCG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:50:14.068" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:04.539" grpc.time_ms=10.321 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1499gitlab # [ 202.145941] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:04 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 20771500gitlab # [ 202.155194] setup-gitlab-start[2238]: + mkdir -p /tmp/test-flake1501gitlab # [ 202.159344] setup-gitlab-start[2238]: + cd /tmp/test-flake1502gitlab # [ 202.161808] setup-gitlab-start[2238]: + git init -b master1503gitlab # [ 202.175327] setup-gitlab-start[2575]: Initialized empty Git repository in /tmp/test-flake/.git/1504gitlab # [ 202.177963] setup-gitlab-start[2238]: + git config user.name test1505gitlab # [ 202.186614] setup-gitlab-start[2238]: + git config user.email test@example.com1506gitlab # [ 202.193226] setup-gitlab-start[2238]: + cat1507gitlab # [ 202.197231] setup-gitlab-start[2238]: + git add flake.nix1508gitlab # [ 202.202891] setup-gitlab-start[2238]: + git commit -m 'initial commit'1509gitlab # [ 202.224237] setup-gitlab-start[2580]: [master (root-commit) 602517e] initial commit1510gitlab # [ 202.226189] setup-gitlab-start[2580]: 1 file changed, 10 insertions(+)1511gitlab # [ 202.228091] setup-gitlab-start[2580]: create mode 100644 flake.nix1512gitlab # [ 202.233699] setup-gitlab-start[2238]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1513gitlab # [ 202.242331] setup-gitlab-start[2238]: + git push -u origin master1514gitlab # [ 202.471883] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:05 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 1951515gitlab # [ 202.756880] gitaly[924]: time="2026-08-11T10:50:05.448Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR736ZNJVB7WMDEJX4TCNM2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:05.434" grpc.time_ms=13.572 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1516gitlab # [ 202.806144] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:05 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 3231517gitlab # [ 203.080699] gitaly[924]: time="2026-08-11T10:50:05.771Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:50:15.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:05.760" grpc.time_ms=10.225 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1518gitlab # [ 203.138524] gitaly[924]: time="2026-08-11T10:50:05.829Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-11T10:50:35.021" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-11T10:50:05.822" grpc.time_ms=7.348 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1519gitlab # [ 203.184925] gitaly[924]: time="2026-08-11T10:50:05.876Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZR737ADP5323Q3EYJCM1VGH duration_ms=208ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/allowed"1520gitlab # [ 203.212591] gitaly[924]: time="2026-08-11T10:50:05.903Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZR737ADP5323Q3EYJCM1VGH duration_ms=26ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/pre_receive"1521gitlab # [ 203.213959] gitaly[924]: time="2026-08-11T10:50:05.904Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:50:05.666" grpc.time_ms=237.711 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1522gitlab # [ 203.276859] gitaly[924]: time="2026-08-11T10:50:05.966Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:50:05.965" grpc.time_ms=0.871 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1523gitlab # [ 203.298047] sidekiq-cluster[2527]: {"severity":"INFO","time":"2026-08-11T10:50:05.971Z","message":"Starting cluster with 1 processes"}1524gitlab # [ 203.320158] gitaly[924]: time="2026-08-11T10:50:06.011Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:50:06.010" grpc.time_ms=0.495 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1525gitlab # [ 203.359617] gitaly[924]: time="2026-08-11T10:50:06.050Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:50:06.050" grpc.time_ms=0.436 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1526gitlab # [ 203.493350] gitaly[924]: time="2026-08-11T10:50:06.184Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:50:16.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:06.173" grpc.time_ms=11.008 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1527gitlab # [ 203.542844] gitaly[924]: time="2026-08-11T10:50:06.208Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1562 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-11T10:50:16.019" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:50:06.189" grpc.time_ms=18.589 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1528gitlab # [ 203.564358] gitaly[924]: time="2026-08-11T10:50:06.221Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZR737ADP5323Q3EYJCM1VGH duration_ms=133ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/post_receive"1529gitlab # [ 203.569209] gitaly[924]: time="2026-08-11T10:50:06.222Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:50:06.087" grpc.time_ms=134.722 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1530gitlab # [ 203.585099] gitaly[924]: time="2026-08-11T10:50:06.242Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH diskcache=0e8118fe-6fbe-4cc0-983d-515d3fcf77a2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:05.584" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1531gitlab # [ 203.600682] setup-gitlab-start[2584]: To http://gitlab/root/test-flake.git1532gitlab # [ 203.602279] setup-gitlab-start[2584]: * [new branch] master -> master1533gitlab # [ 203.603866] setup-gitlab-start[2584]: branch 'master' set up to track 'origin/master'.1534gitlab # [ 203.606110] gitlab-workhorse[824]: time="2026-08-11T10:50:06Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521535gitlab # [ 203.609235] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:06 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7261536gitlab # [ 203.612712] systemd[1]: Finished setup-gitlab.service.1537gitlab # [ 203.614124] gitaly[924]: time="2026-08-11T10:50:06.242Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=222 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13268 command.oublock=32 command.real_time_ms=648 command.spawn_token_fork_ms=0 command.system_time_ms=158 command.user_time_ms=64 component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:05.584" grpc.time_ms=658.762 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1538gitlab # [ 203.635070] systemd[1]: Starting nixbot CI service...1539gitlab: (finished: waiting for unit setup-gitlab.service, in 205.10 seconds)1540gitlab: waiting for unit nixbot.service1541gitlab # [ 204.717817] nixbot[2679]: {"ts": "2026-08-11T10:50:07.408Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1542gitlab # [ 204.752117] nixbot[2679]: {"ts": "2026-08-11T10:50:07.443Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1543gitlab # [ 204.782262] nixbot[2679]: {"ts": "2026-08-11T10:50:07.473Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1544gitlab # [ 204.789405] nixbot[2679]: {"ts": "2026-08-11T10:50:07.479Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1545gitlab # [ 204.796518] nixbot[2679]: {"ts": "2026-08-11T10:50:07.485Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1546gitlab # [ 204.803561] nixbot[2679]: {"ts": "2026-08-11T10:50:07.494Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1547gitlab # [ 204.808985] nixbot[2679]: {"ts": "2026-08-11T10:50:07.500Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1548gitlab # [ 204.813341] nixbot[2679]: {"ts": "2026-08-11T10:50:07.503Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1549gitlab # [ 204.821509] nixbot[2679]: {"ts": "2026-08-11T10:50:07.512Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1550gitlab # [ 204.826320] nixbot[2679]: {"ts": "2026-08-11T10:50:07.516Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1551gitlab # [ 204.835235] nixbot[2679]: {"ts": "2026-08-11T10:50:07.526Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1552gitlab # [ 204.849199] nixbot[2679]: {"ts": "2026-08-11T10:50:07.540Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1553gitlab # [ 204.859111] nixbot[2679]: {"ts": "2026-08-11T10:50:07.550Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1554gitlab # [ 204.863657] nixbot[2679]: {"ts": "2026-08-11T10:50:07.554Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1555gitlab # [ 204.870635] nixbot[2679]: {"ts": "2026-08-11T10:50:07.561Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1556gitlab # [ 204.877314] nixbot[2679]: {"ts": "2026-08-11T10:50:07.568Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1557gitlab # [ 204.884564] nixbot[2679]: {"ts": "2026-08-11T10:50:07.575Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1558gitlab # [ 204.889978] nixbot[2679]: {"ts": "2026-08-11T10:50:07.581Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1559gitlab # [ 204.896893] nixbot[2679]: {"ts": "2026-08-11T10:50:07.588Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1560gitlab # [ 204.899232] nixbot[2679]: {"ts": "2026-08-11T10:50:07.590Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1561gitlab # [ 204.906416] nixbot[2679]: {"ts": "2026-08-11T10:50:07.597Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1562gitlab # [ 204.912245] nixbot[2679]: {"ts": "2026-08-11T10:50:07.603Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1563gitlab # [ 204.919063] nixbot[2679]: {"ts": "2026-08-11T10:50:07.610Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1564gitlab # [ 204.926038] nixbot[2679]: {"ts": "2026-08-11T10:50:07.617Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1565gitlab # [ 204.932447] nixbot[2679]: {"ts": "2026-08-11T10:50:07.623Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1566gitlab # [ 205.243834] nixbot[2679]: INFO: Started server process [2679]1567gitlab # [ 205.245185] nixbot[2679]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1568gitlab # [ 205.275190] nixbot[2679]: INFO: ::ffff:127.0.0.1:52654 - "GET /health HTTP/1.1" 200 OK1569gitlab # [ 205.281432] systemd[1]: Started nixbot CI service.1570gitlab # [ 205.283662] systemd[1]: Reached target Multi-User System.1571gitlab # [ 205.286371] systemd[1]: Startup finished in 1.405s (kernel) + 3.699s (initrd) + 3min 20.181s (userspace) = 3min 25.285s.1572gitlab: (finished: waiting for unit nixbot.service, in 1.05 seconds)1573gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1574gitlab # [ 205.349277] nixbot[2679]: INFO: ::ffff:127.0.0.1:52658 - "GET /health HTTP/1.1" 200 OK1575gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1576subtest: project discovered and webhook registered1577gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1578gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.09 seconds)1579gitlab # [ 205.444959] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 641580gitlab # [ 206.010925] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:08 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 7311581gitlab # [ 206.021374] nixbot[2679]: {"ts": "2026-08-11T10:50:08.704Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1582gitlab # [ 206.032749] nixbot[2679]: {"ts": "2026-08-11T10:50:08.723Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1583gitlab # [ 206.105249] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 591584gitlab # [ 206.109244] nixbot[2679]: {"ts": "2026-08-11T10:50:08.797Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1585gitlab # [ 206.111788] nixbot[2679]: {"ts": "2026-08-11T10:50:08.798Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1586gitlab # [ 206.231748] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 1001587gitlab # [ 206.235182] nixbot[2679]: {"ts": "2026-08-11T10:50:08.923Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1588gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1589gitlab # [ 206.484116] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:09 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2231590gitlab # [ 206.486068] nixbot[2679]: {"ts": "2026-08-11T10:50:09.176Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1591gitlab # [ 206.562111] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 571592gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.12 seconds)1593(finished: subtest: project discovered and webhook registered, in 1.22 seconds)1594subtest: push delivers the webhook1595gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1596gitlab # [ 206.590121] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 731597gitlab # [ 206.592126] nixbot[2679]: {"ts": "2026-08-11T10:50:09.283Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1598gitlab # [ 206.652747] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:09 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 241599gitlab # [ 206.671598] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:09 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 761600gitlab # [ 206.676724] nixbot[2679]: {"ts": "2026-08-11T10:50:09.366Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1601gitlab # [ 206.736453] gitaly[924]: time="2026-08-11T10:50:09.426Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73B2XXJWPSYQW4TZJE08E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-11T10:50:39.010" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:50:09.411" grpc.time_ms=15.225 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1602gitlab # [ 206.753331] gitaly[924]: time="2026-08-11T10:50:09.444Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR73B22R53KQCJMSESGG1Y8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:09.439" grpc.time_ms=5.369 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1603gitlab # [ 206.756628] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:09 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 1011604gitlab # [ 206.759482] gitaly[924]: time="2026-08-11T10:50:09.450Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73B2XXJWPSYQW4TZJE08E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:50:39.049" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:50:09.450" grpc.time_ms=0.665 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1605gitlab # [ 206.819144] gitaly[924]: time="2026-08-11T10:50:09.489Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=28 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73B2XXJWPSYQW4TZJE08E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-11T10:50:19.286" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:50:09.456" grpc.time_ms=32.908 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1606gitlab # [ 206.823443] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1401607gitlab # [ 206.851864] nixbot[2679]: {"ts": "2026-08-11T10:50:09.543Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1608gitlab # Enumerating objects: 5, done.1609gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1610gitlab # Delta compression using up to 4 threads1611gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1612gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done.1613gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1614gitlab # [ 206.924186] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 681615gitlab # [ 206.925379] nixbot[2679]: {"ts": "2026-08-11T10:50:09.616Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1616gitlab # [ 206.929398] nixbot[2679]: {"ts": "2026-08-11T10:50:09.620Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1617gitlab # [ 207.011763] gitaly[924]: time="2026-08-11T10:50:09.702Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR73BBPYXGG77DK2RWBG400 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:09.695" grpc.time_ms=7.498 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1618gitlab # [ 207.012989] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 481619gitlab # [ 207.082676] gitaly[924]: time="2026-08-11T10:50:09.769Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-11T10:50:39.063" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-11T10:50:09.763" grpc.time_ms=6.352 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1620gitlab # [ 207.104942] gitaly[924]: time="2026-08-11T10:50:09.788Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 duration_ms=109ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/allowed"1621gitlab # [ 207.109619] gitaly[924]: time="2026-08-11T10:50:09.798Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR73BDA18HE9TY5CNN2H9MJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:09.769" pid=924 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1622gitlab # [ 207.127087] gitaly[924]: time="2026-08-11T10:50:09.799Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73BDA18HE9TY5CNN2H9MJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:09.769" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1623gitlab # [ 207.147704] gitlab-workhorse[824]: time="2026-08-11T10:50:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131624gitlab # [ 207.150896] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 951625gitlab # [ 207.154176] gitaly[924]: time="2026-08-11T10:50:09.804Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73BDA18HE9TY5CNN2H9MJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:09.769" grpc.time_ms=31.019 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1626gitlab # [ 207.176712] gitaly[924]: time="2026-08-11T10:50:09.813Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 duration_ms=24ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/pre_receive"1627gitlab # [ 207.181672] gitaly[924]: time="2026-08-11T10:50:09.813Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:50:09.678" grpc.time_ms=134.681 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1628gitlab # [ 207.197634] gitaly[924]: time="2026-08-11T10:50:09.861Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:50:09.861" grpc.time_ms=0.4 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1629gitlab # [ 207.213488] gitaly[924]: time="2026-08-11T10:50:09.893Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:50:09.892" grpc.time_ms=0.593 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1630gitlab # [ 207.233416] gitaly[924]: time="2026-08-11T10:50:09.924Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:50:09.923" grpc.time_ms=1.613 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1631gitlab # [ 207.288951] gitaly[924]: time="2026-08-11T10:50:09.980Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR73BGH0Y0FJZKS4WNFXPE5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:09.961" pid=924 remote_ip="2001:db8:1::1" request_sha=b4160bd55147a0e0bc6248806cfc55c762d08c7b response_bytes=224 span.kind=server system=grpc1632gitlab # [ 207.305227] gitaly[924]: time="2026-08-11T10:50:09.980Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73BGH0Y0FJZKS4WNFXPE5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:09.961" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1633gitlab # [ 207.327490] gitlab-workhorse[824]: time="2026-08-11T10:50:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2241634gitlab # [ 207.328737] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 224 "" "git/2.55.0" 1721635gitlab # [ 207.329910] gitaly[924]: time="2026-08-11T10:50:09.980Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73BGH0Y0FJZKS4WNFXPE5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:09.961" grpc.time_ms=18.749 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1636gitlab # [ 207.335208] gitaly[924]: time="2026-08-11T10:50:10.026Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 duration_ms=58ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/post_receive"1637gitlab # [ 207.337237] gitaly[924]: time="2026-08-11T10:50:10.028Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:50:09.967" grpc.time_ms=60.461 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1638gitlab # [ 207.389947] gitaly[924]: time="2026-08-11T10:50:10.080Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 diskcache=8199c62a-4ad5-4da5-bdfe-60385fb06da6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:09.625" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1639gitlab # [ 207.391099] gitaly[924]: time="2026-08-11T10:50:10.081Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=154 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13101 command.oublock=32 command.real_time_ms=442 command.spawn_token_fork_ms=1 command.system_time_ms=113 command.user_time_ms=41 component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:09.625" grpc.time_ms=455.116 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1640gitlab # [ 207.391865] gitlab-workhorse[824]: time="2026-08-11T10:50:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521641gitlab # [ 207.392672] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:10 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5161642gitlab # [ 207.431637] gitaly[924]: time="2026-08-11T10:50:10.122Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR73BRP4T63M497YKSPV6VV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:10.113" grpc.time_ms=9.501 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1643gitlab # [ 207.432660] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 521644gitlab # To http://gitlab/root/test-flake.git1645gitlab # 602517e..98f31e4 master -> master1646gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.89 seconds)1647gitlab: must succeed: git -C /tmp/test-flake rev-parse master1648gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1649gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1650gitlab # [ 207.494288] gitaly[924]: time="2026-08-11T10:50:10.185Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR73BTEFF4CVKZ4ABNQ4ZDD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:10.177" pid=924 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1651gitlab # [ 207.495724] gitaly[924]: time="2026-08-11T10:50:10.187Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73BTEFF4CVKZ4ABNQ4ZDD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:10.177" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1652gitlab # [ 207.498726] gitlab-workhorse[824]: time="2026-08-11T10:50:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671653gitlab # [ 207.499825] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 621654gitlab # [ 207.504637] gitaly[924]: time="2026-08-11T10:50:10.195Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73BTEFF4CVKZ4ABNQ4ZDD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:10.177" grpc.time_ms=10.781 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1655gitlab # [ 207.562573] nixbot[2679]: INFO: ::ffff:127.0.0.1:52670 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1656gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.08 seconds)1657gitlab # [ 207.571726] gitaly[924]: time="2026-08-11T10:50:10.262Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR73BWJ81RF3W0DP94AQ2KN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:10.243" pid=924 remote_ip="2001:db8:1::1" request_sha=b6e535986fb039f7ea7d7f5172db27d8cd9ea753 response_bytes=337 span.kind=server system=grpc1658gitlab # [ 207.588785] gitaly[924]: time="2026-08-11T10:50:10.263Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1192 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73BWJ81RF3W0DP94AQ2KN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:10.243" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1659gitlab # [ 207.610488] gitlab-workhorse[824]: time="2026-08-11T10:50:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3371660gitlab # [ 207.613616] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 691661gitlab # [ 207.616823] gitaly[924]: time="2026-08-11T10:50:10.263Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1192 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73BWJ81RF3W0DP94AQ2KN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:10.243" grpc.time_ms=20.47 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1662gitlab # [ 207.658684] gitaly[924]: time="2026-08-11T10:50:10.349Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR73BZYNPJE9E0XWE2A24YM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:10.341" grpc.time_ms=8.058 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1663gitlab # [ 207.679464] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 471664gitlab # [ 207.730058] gitaly[924]: time="2026-08-11T10:50:10.421Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR73C1HH979K7576FT50HP5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:10.403" pid=924 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1665gitlab # [ 207.731640] gitaly[924]: time="2026-08-11T10:50:10.421Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1165 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73C1HH979K7576FT50HP5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:10.403" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1666gitlab # [ 207.733429] gitaly[924]: time="2026-08-11T10:50:10.423Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1165 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73C1HH979K7576FT50HP5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:10.403" grpc.time_ms=18.954 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1667gitlab # [ 207.735192] gitlab-workhorse[824]: time="2026-08-11T10:50:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091668gitlab # [ 207.736162] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 701669gitlab # [ 207.896940] gitaly[924]: time="2026-08-11T10:50:10.587Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:50:40.185" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:50:10.585" grpc.time_ms=0.936 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1670gitlab # [ 207.986499] gitaly[924]: time="2026-08-11T10:50:10.677Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-11T10:50:40.260" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:50:10.661" grpc.time_ms=15.038 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1671gitlab # [ 208.054936] gitaly[924]: time="2026-08-11T10:50:10.746Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:50:20.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:50:10.734" grpc.time_ms=12.079 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1672gitlab # [ 208.087669] gitaly[924]: time="2026-08-11T10:50:10.778Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:50:20.016" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:50:10.767" grpc.time_ms=11.435 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1673gitlab # [ 208.168803] gitaly[924]: time="2026-08-11T10:50:10.859Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T10:50:20.108" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:10.859" grpc.time_ms=0.295 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1674gitlab # [ 208.221228] gitaly[924]: time="2026-08-11T10:50:10.912Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T10:50:20.152" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:50:10.902" grpc.time_ms=9.791 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1675gitlab # [ 208.270815] gitaly[924]: time="2026-08-11T10:50:10.962Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:50:10.961" grpc.time_ms=0.334 pid=924 span.kind=server system=grpc1676gitlab # [ 208.308671] gitaly[924]: time="2026-08-11T10:50:10.999Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:50:10.999" grpc.time_ms=0.372 pid=924 span.kind=server system=grpc1677gitlab # [ 208.333925] gitaly[924]: time="2026-08-11T10:50:11.025Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH diskcache=0e8be39c-68dc-4655-a3a6-ade9cad631e7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:50:20.165" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:10.916" pid=924 ref=refs/keep-around/602517e9867335656a7404cbf404a70e499058fa remote_ip="2001:db8:1::1" revision=602517e9867335656a7404cbf404a70e499058fa span.kind=server system=grpc username=root1678gitlab # [ 208.351872] gitaly[924]: time="2026-08-11T10:50:11.043Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=83 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5244 command.oublock=8 command.real_time_ms=99 command.spawn_token_fork_ms=2 command.system_time_ms=61 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:50:20.165" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:50:10.916" grpc.time_ms=108.151 pid=924 ref=refs/keep-around/602517e9867335656a7404cbf404a70e499058fa remote_ip="2001:db8:1::1" revision=602517e9867335656a7404cbf404a70e499058fa span.kind=server system=grpc username=root1679gitlab # [ 208.355980] gitaly[924]: time="2026-08-11T10:50:11.047Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:50:41.046" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:50:11.046" grpc.time_ms=0.369 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1680gitlab # [ 208.557901] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/602517e9867335656a7404cbf404a70e499058fa HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 7291681gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1682gitlab # [ 208.567169] nixbot[2679]: {"ts": "2026-08-11T10:50:11.249Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/602517e9867335656a7404cbf404a70e499058fa \"HTTP/1.1 201 Created\""}1683gitlab # [ 208.575871] nixbot[2679]: {"ts": "2026-08-11T10:50:11.256Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-602517e98673-0"}1684gitlab # [ 208.596575] nixbot[2679]: INFO: ::ffff:127.0.0.1:52686 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1685gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.03 seconds)1686gitlab # [ 208.633578] systemd[1]: Started Nix Daemon.1687gitlab # [ 208.674539] nix-daemon[2893]: accepted connection from pid 2884, user nixbot1688gitlab # [ 208.760600] nix-daemon[2893]: accepted connection from pid 2900, user nixbot1689gitlab # [ 208.780790] nixbot[2679]: {"ts": "2026-08-11T10:50:11.471Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-602517e98673-0", "argv0": "bwrap"}1690gitlab # [ 208.902441] nix-daemon[2893]: accepted connection from pid 2910, user nixbot1691gitlab # [ 208.941724] nix-daemon[2893]: accepted connection from pid 2920, user nixbot1692gitlab # [ 208.961471] nix-daemon[2893]: accepted connection from pid 2910, user nixbot1693gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1694gitlab # [ 209.643556] nixbot[2679]: INFO: ::ffff:127.0.0.1:52694 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1695gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1696gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1697gitlab # [ 210.690722] nixbot[2679]: INFO: ::ffff:127.0.0.1:52706 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1698gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1699gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1700gitlab # [ 211.740493] nixbot[2679]: INFO: ::ffff:127.0.0.1:52718 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1701gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1702gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1703gitlab # [ 212.774885] nixbot[2679]: INFO: ::ffff:127.0.0.1:52724 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1704gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.03 seconds)1705gitlab # [ 213.492538] nix-daemon[2893]: accepted connection from pid 2949, user nixbot1706gitlab # [ 213.556585] gitaly[924]: time="2026-08-11T10:50:16.247Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73HQ1XS92MPH7QDD8EYR2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:50:46.044" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:50:16.245" grpc.time_ms=1.181 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1707gitlab # [ 213.646959] gitaly[924]: time="2026-08-11T10:50:16.338Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR73HQ1XS92MPH7QDD8EYR2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:50:26.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:50:16.325" grpc.time_ms=12.216 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1708gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1709gitlab # [ 213.796528] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:16 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/602517e9867335656a7404cbf404a70e499058fa HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 3251710gitlab # [ 213.807461] nixbot[2679]: {"ts": "2026-08-11T10:50:16.497Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/602517e9867335656a7404cbf404a70e499058fa \"HTTP/1.1 201 Created\""}1711gitlab # [ 213.843893] nixbot[2679]: INFO: ::ffff:127.0.0.1:60604 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1712gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.06 seconds)1713gitlab # [ 213.884397] gitaly[924]: time="2026-08-11T10:50:16.575Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73J25X8TP9D6B9G7V18C3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:50:46.573" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:50:16.574" grpc.time_ms=1.045 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1714gitlab # [ 213.946312] gitaly[924]: time="2026-08-11T10:50:16.637Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR73J25X8TP9D6B9G7V18C3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:50:26.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:50:16.626" grpc.time_ms=11.106 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1715gitlab # [ 213.992594] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:16 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/602517e9867335656a7404cbf404a70e499058fa HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1651716gitlab # [ 213.996862] nixbot[2679]: {"ts": "2026-08-11T10:50:16.685Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/602517e9867335656a7404cbf404a70e499058fa \"HTTP/1.1 201 Created\""}1717gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1718gitlab # [ 214.889692] nixbot[2679]: INFO: ::ffff:127.0.0.1:60606 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1719gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1720gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1721gitlab # [ 215.939212] nixbot[2679]: INFO: ::ffff:127.0.0.1:60610 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1722gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1723gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1724gitlab # [ 216.988910] nixbot[2679]: INFO: ::ffff:127.0.0.1:60626 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1725gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1726gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1727gitlab # [ 218.038518] nixbot[2679]: INFO: ::ffff:127.0.0.1:60630 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1728gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1729gitlab # [ 218.485621] nix-daemon[2893]: accepted connection from pid 2993, user nixbot1730gitlab # [ 218.593065] gitaly[924]: time="2026-08-11T10:50:21.282Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73PMVADZY6Z6V7BRECQ5W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:50:51.079" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:50:21.280" grpc.time_ms=1.896 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1731gitlab # [ 218.628645] gitaly[924]: time="2026-08-11T10:50:21.319Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR73PMVADZY6Z6V7BRECQ5W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:50:31.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:50:21.309" grpc.time_ms=10.094 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1732gitlab # [ 218.714416] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/602517e9867335656a7404cbf404a70e499058fa HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1921733gitlab # [ 218.716966] nixbot[2679]: {"ts": "2026-08-11T10:50:21.406Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/602517e9867335656a7404cbf404a70e499058fa \"HTTP/1.1 201 Created\""}1734gitlab # [ 218.797548] nix-daemon[2893]: accepted connection from pid 3007, user nixbot1735gitlab # [ 218.922490] gitaly[924]: time="2026-08-11T10:50:21.613Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=5 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR73PZMV2ZZJAWZKF5E0E6R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:21.598" grpc.time_ms=14.789 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1736gitlab # [ 218.926849] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:21 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 611737gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1738gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.02 seconds)1739gitlab # [ 219.049529] gitaly[924]: time="2026-08-11T10:50:21.740Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR73Q2VC2273427JJH2BCXG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:21.725" pid=924 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1740gitlab # [ 219.051899] gitaly[924]: time="2026-08-11T10:50:21.740Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73Q2VC2273427JJH2BCXG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:21.725" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1741gitlab # [ 219.055793] gitaly[924]: time="2026-08-11T10:50:21.741Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73Q2VC2273427JJH2BCXG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:50:21.725" grpc.time_ms=15.081 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1742gitlab # [ 219.070819] nixbot[2679]: INFO: ::ffff:127.0.0.1:60642 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1743gitlab # [ 219.135507] gitlab-workhorse[824]: time="2026-08-11T10:50:21Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671744gitlab # [ 219.137511] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:50:21 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1661745gitlab # [ 219.209281] nix-daemon[2893]: accepted connection from pid 3035, user nixbot1746gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1747gitlab # [ 220.113671] nixbot[2679]: INFO: ::ffff:127.0.0.1:60644 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1748gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1749gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1750gitlab # [ 221.163207] nixbot[2679]: INFO: ::ffff:127.0.0.1:60654 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1751gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1752gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1753gitlab # [ 222.212688] nixbot[2679]: INFO: ::ffff:127.0.0.1:60670 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1754gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1755gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1756gitlab # [ 223.262640] nixbot[2679]: INFO: ::ffff:127.0.0.1:59490 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1757gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1758gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1759gitlab # [ 224.311523] nixbot[2679]: INFO: ::ffff:127.0.0.1:59504 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1760gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1761gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1762gitlab # [ 225.362320] nixbot[2679]: INFO: ::ffff:127.0.0.1:59508 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1763gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1764gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1765gitlab # [ 226.411799] nixbot[2679]: INFO: ::ffff:127.0.0.1:59522 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1766gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1767gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1768gitlab # [ 227.460642] nixbot[2679]: INFO: ::ffff:127.0.0.1:59524 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1769gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1770gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1771gitlab # [ 228.510369] nixbot[2679]: INFO: ::ffff:127.0.0.1:59528 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1772gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1773gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1774gitlab # [ 229.559447] nixbot[2679]: INFO: ::ffff:127.0.0.1:59544 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1775gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1776gitlab # [ 229.697311] sidekiq-cluster[2640]: 2026-08-11T10:50:32.387Z pid=2640 tid=xdk INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2640, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432697344}1777gitlab # [ 229.879239] sidekiq-cluster[2640]: W, [2026-08-11T10:50:32.570098 #2640] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1778gitlab # [ 229.918828] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:50:32.609Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1779gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1780gitlab # [ 230.608946] nixbot[2679]: INFO: ::ffff:127.0.0.1:59552 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1781gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1782gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1783gitlab # [ 231.660749] nixbot[2679]: INFO: ::ffff:127.0.0.1:59554 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1784gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1785gitlab # [ 231.814850] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:50:34.505Z","message":"GitLab reliable fetch activated!"}1786gitlab # [ 231.818141] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:50:34.505Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1787gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1788gitlab # [ 232.709858] nixbot[2679]: INFO: ::ffff:127.0.0.1:59562 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1789gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1790gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1791gitlab # [ 233.758639] nixbot[2679]: INFO: ::ffff:127.0.0.1:53140 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1792gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1793gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1794gitlab # [ 234.809807] nixbot[2679]: INFO: ::ffff:127.0.0.1:53156 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1795gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1796gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1797gitlab # [ 235.857987] nixbot[2679]: INFO: ::ffff:127.0.0.1:53160 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1798gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1799gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1800gitlab # [ 236.909636] nixbot[2679]: INFO: ::ffff:127.0.0.1:53166 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1801gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1802gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1803gitlab # [ 237.959121] nixbot[2679]: INFO: ::ffff:127.0.0.1:53172 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1804gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1805gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1806gitlab # [ 239.008369] nixbot[2679]: INFO: ::ffff:127.0.0.1:53186 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1807gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1808gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1809gitlab # [ 240.058713] nixbot[2679]: INFO: ::ffff:127.0.0.1:53192 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1810gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1811gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1812gitlab # [ 241.108661] nixbot[2679]: INFO: ::ffff:127.0.0.1:53206 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1813gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1814gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1815gitlab # [ 242.158825] nixbot[2679]: INFO: ::ffff:127.0.0.1:53208 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1816gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1817gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1818gitlab # [ 243.208629] nixbot[2679]: INFO: ::ffff:127.0.0.1:51844 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1819gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1820gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1821gitlab # [ 244.258830] nixbot[2679]: INFO: ::ffff:127.0.0.1:51860 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1822gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1823gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1824gitlab # [ 245.307953] nixbot[2679]: INFO: ::ffff:127.0.0.1:51874 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1825gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1826gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1827gitlab # [ 246.358649] nixbot[2679]: INFO: ::ffff:127.0.0.1:51882 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1828gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1829gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1830gitlab # [ 247.407707] nixbot[2679]: INFO: ::ffff:127.0.0.1:51894 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1831gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1832gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1833gitlab # [ 248.457447] nixbot[2679]: INFO: ::ffff:127.0.0.1:51898 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1834gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1835gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1836gitlab # [ 249.505416] nixbot[2679]: INFO: ::ffff:127.0.0.1:51910 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1837gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1838gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1839gitlab # [ 250.556540] nixbot[2679]: INFO: ::ffff:127.0.0.1:51918 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1840gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1841gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1842gitlab # [ 251.605763] nixbot[2679]: INFO: ::ffff:127.0.0.1:51926 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1843gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1844gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1845gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.04 seconds)1846gitlab # [ 252.654843] nixbot[2679]: INFO: ::ffff:127.0.0.1:51930 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1847gitlab # [ 253.267453] postgres[3151]: [3151] ERROR: relation "table_without_models" does not exist1848gitlab # [ 253.271299] postgres[3151]: [3151] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1849gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1850gitlab # [ 253.697164] nixbot[2679]: INFO: ::ffff:127.0.0.1:35472 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1851gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1852gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1853gitlab # [ 254.748354] nixbot[2679]: INFO: ::ffff:127.0.0.1:35482 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1854gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1855gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1856gitlab # [ 255.798737] nixbot[2679]: INFO: ::ffff:127.0.0.1:35488 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1857gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1858gitlab # [ 256.043884] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:50:58.734Z","message":"Booted Rails 7.2.3.1 application in production environment"}1859gitlab # [ 256.046693] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:50:58.734Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1860gitlab # [ 256.049152] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:50:58.734Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1861gitlab # [ 256.052093] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:50:58.734Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1862gitlab # [ 256.054060] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:50:58.737Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1863gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1864gitlab # [ 256.849521] nixbot[2679]: INFO: ::ffff:127.0.0.1:35502 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1865gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1866gitlab # [ 257.433730] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:00.123Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"9d45736ca3965d72546204a2","created_at":"2026-08-11T10:50:03.830Z","trace_propagation_headers":{"sentry-trace":"c0d1345e8db54f0b93d15bed6946c9c3-aab53a2542094a11","baggage":"sentry-trace_id=c0d1345e8db54f0b93d15bed6946c9c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR734M5VM4N2ACSKNCBNVCG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T10:50:03.856Z","job_size_bytes":2,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-9d45736ca3965d72546204a2: start","job_status":"start","queue_duration_s":56.267068,"scheduling_latency_s":56.267115}1867gitlab # [ 257.704922] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:00.395Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"9d45736ca3965d72546204a2","created_at":"2026-08-11T10:50:03.830Z","trace_propagation_headers":{"sentry-trace":"c0d1345e8db54f0b93d15bed6946c9c3-aab53a2542094a11","baggage":"sentry-trace_id=c0d1345e8db54f0b93d15bed6946c9c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR734M5VM4N2ACSKNCBNVCG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T10:50:03.856Z","job_size_bytes":2,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-9d45736ca3965d72546204a2: done: 0.271289 sec","job_status":"done","queue_duration_s":56.267068,"scheduling_latency_s":56.267115,"redis_calls":23,"redis_duration_s":0.014877999999999999,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.007769,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004273,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002836,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.124429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.110957956,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.271289,"completed_at":"2026-08-11T10:51:00.394Z","load_balancing_strategy":"primary","db_duration_s":0.06499,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1868gitlab # [ 257.710654] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:00.398Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"6659fb4b4cef9400e6bdbc65","created_at":"2026-08-11T10:50:03.864Z","trace_propagation_headers":{"sentry-trace":"c0d1345e8db54f0b93d15bed6946c9c3-aab53a2542094a11","baggage":"sentry-trace_id=c0d1345e8db54f0b93d15bed6946c9c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR734M5VM4N2ACSKNCBNVCG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-11T10:50:03.869Z","job_size_bytes":2,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-6659fb4b4cef9400e6bdbc65: start","job_status":"start","queue_duration_s":56.529048,"scheduling_latency_s":56.529089}1869gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1870gitlab # [ 257.827784] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:00.502Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"6659fb4b4cef9400e6bdbc65","created_at":"2026-08-11T10:50:03.864Z","trace_propagation_headers":{"sentry-trace":"c0d1345e8db54f0b93d15bed6946c9c3-aab53a2542094a11","baggage":"sentry-trace_id=c0d1345e8db54f0b93d15bed6946c9c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR734M5VM4N2ACSKNCBNVCG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-11T10:50:03.869Z","job_size_bytes":2,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-6659fb4b4cef9400e6bdbc65: done: 0.103917 sec","job_status":"done","queue_duration_s":56.529048,"scheduling_latency_s":56.529089,"redis_calls":14,"redis_duration_s":0.007426,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001697,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003148,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002581,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06917303699999999,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.103917,"completed_at":"2026-08-11T10:51:00.501Z","load_balancing_strategy":"primary","db_duration_s":0.029895,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1871gitlab # [ 257.836170] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:00.504Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"7ebc2ccbca3f4ea3feb1979a","created_at":"2026-08-11T10:50:04.424Z","trace_propagation_headers":{"sentry-trace":"c0d1345e8db54f0b93d15bed6946c9c3-aab53a2542094a11","baggage":"sentry-trace_id=c0d1345e8db54f0b93d15bed6946c9c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR734M5VM4N2ACSKNCBNVCG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-11T10:50:04.431Z","job_size_bytes":5,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-7ebc2ccbca3f4ea3feb1979a: start","job_status":"start","queue_duration_s":56.072434,"scheduling_latency_s":56.072455}1872gitlab # [ 257.926950] nixbot[2679]: INFO: ::ffff:127.0.0.1:35514 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1873gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.08 seconds)1874gitlab # [ 257.956442] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:00.647Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"7ebc2ccbca3f4ea3feb1979a","created_at":"2026-08-11T10:50:04.424Z","trace_propagation_headers":{"sentry-trace":"c0d1345e8db54f0b93d15bed6946c9c3-aab53a2542094a11","baggage":"sentry-trace_id=c0d1345e8db54f0b93d15bed6946c9c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR734M5VM4N2ACSKNCBNVCG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-11T10:50:04.431Z","job_size_bytes":5,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-7ebc2ccbca3f4ea3feb1979a: done: 0.14297 sec","job_status":"done","queue_duration_s":56.072434,"scheduling_latency_s":56.072455,"redis_calls":12,"redis_duration_s":0.006133,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001294,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003847,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000909334,"duration_s":0.14297,"completed_at":"2026-08-11T10:51:00.646Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032494,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1875gitlab # [ 258.029780] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:00.720Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"30ba6fcff24128259009550e","created_at":"2026-08-11T10:50:04.459Z","trace_propagation_headers":{"sentry-trace":"c0d1345e8db54f0b93d15bed6946c9c3-aab53a2542094a11","baggage":"sentry-trace_id=c0d1345e8db54f0b93d15bed6946c9c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR734M5VM4N2ACSKNCBNVCG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-11T10:50:04.464Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-30ba6fcff24128259009550e: start","job_status":"start","queue_duration_s":56.255854,"scheduling_latency_s":56.255908}1876gitlab # [ 258.284860] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:00.975Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"30ba6fcff24128259009550e","created_at":"2026-08-11T10:50:04.459Z","trace_propagation_headers":{"sentry-trace":"c0d1345e8db54f0b93d15bed6946c9c3-aab53a2542094a11","baggage":"sentry-trace_id=c0d1345e8db54f0b93d15bed6946c9c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR734M5VM4N2ACSKNCBNVCG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-11T10:50:04.464Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-30ba6fcff24128259009550e: done: 0.255126 sec","job_status":"done","queue_duration_s":56.255854,"scheduling_latency_s":56.255908,"redis_calls":11,"redis_duration_s":0.00587,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001735,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00312,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.194,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.194,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.145194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000521296,"duration_s":0.255126,"completed_at":"2026-08-11T10:51:00.975Z","load_balancing_strategy":"primary","db_duration_s":0.10567,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1877gitlab # [ 258.290385] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:00.977Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"eadc636867f2fd303cdeabbf","created_at":"2026-08-11T10:50:04.467Z","trace_propagation_headers":{"sentry-trace":"c0d1345e8db54f0b93d15bed6946c9c3-aab53a2542094a11","baggage":"sentry-trace_id=c0d1345e8db54f0b93d15bed6946c9c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR734M5VM4N2ACSKNCBNVCG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-11T10:50:04.471Z","job_size_bytes":89,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-eadc636867f2fd303cdeabbf: start","job_status":"start","queue_duration_s":56.506118,"scheduling_latency_s":56.506139}1878gitlab # [ 258.477223] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:01.166Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"eadc636867f2fd303cdeabbf","created_at":"2026-08-11T10:50:04.467Z","trace_propagation_headers":{"sentry-trace":"c0d1345e8db54f0b93d15bed6946c9c3-aab53a2542094a11","baggage":"sentry-trace_id=c0d1345e8db54f0b93d15bed6946c9c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR734M5VM4N2ACSKNCBNVCG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-11T10:50:04.471Z","job_size_bytes":89,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-eadc636867f2fd303cdeabbf: done: 0.189113 sec","job_status":"done","queue_duration_s":56.506118,"scheduling_latency_s":56.506139,"redis_calls":11,"redis_duration_s":0.127765,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001183,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003057,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.123525,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000941739,"duration_s":0.189113,"completed_at":"2026-08-11T10:51:01.166Z","load_balancing_strategy":"primary","db_duration_s":0.009501,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1879gitlab # [ 258.564699] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:01.254Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 602517e9867335656a7404cbf404a70e499058fa refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"bf0b916a9017054b7b672ce1","created_at":"2026-08-11T10:50:06.119Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-67e5b9a95793415d","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:50:06.141Z","job_size_bytes":185,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-bf0b916a9017054b7b672ce1: start","job_status":"start","queue_duration_s":55.113202,"scheduling_latency_s":55.113267}1880gitlab # [ 258.603578] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:01.294Z","message":"changes: \"0000000000000000000000000000000000000000 602517e9867335656a7404cbf404a70e499058fa refs/heads/master\\n\""}1881gitlab # [ 258.682102] gitaly[924]: time="2026-08-11T10:51:01.372Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:51:11.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:01.355" grpc.time_ms=17.012 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1882gitlab # [ 258.713914] gitaly[924]: time="2026-08-11T10:51:01.405Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:51:11.031" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:51:01.382" grpc.time_ms=22.171 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1883gitlab # [ 258.771752] gitaly[924]: time="2026-08-11T10:51:01.462Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-11T10:51:11.103" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:01.453" grpc.time_ms=9.002 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1884gitlab # [ 258.833525] gitaly[924]: time="2026-08-11T10:51:01.524Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:51:01.523" grpc.time_ms=0.741 pid=924 span.kind=server system=grpc1885gitlab # [ 258.876116] gitaly[924]: time="2026-08-11T10:51:01.567Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:51:01.566" grpc.time_ms=0.784 pid=924 span.kind=server system=grpc1886gitlab # [ 258.900327] gitaly[924]: time="2026-08-11T10:51:01.591Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH diskcache=37db844f-1c4b-4841-98b5-8dec012541d1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:51:11.123" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:51:01.473" pid=924 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1887gitlab # [ 258.901444] gitaly[924]: time="2026-08-11T10:51:01.591Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=107 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5277 command.oublock=8 command.real_time_ms=109 command.spawn_token_fork_ms=1 command.system_time_ms=60 command.user_time_ms=47 component=gitaly.UnaryServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:51:11.123" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:51:01.473" grpc.time_ms=117.793 pid=924 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1888gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1889gitlab # [ 258.924305] gitaly[924]: time="2026-08-11T10:51:01.615Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:51:11.264" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:51:01.615" grpc.time_ms=0.165 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1890gitlab # [ 258.937131] gitaly[924]: time="2026-08-11T10:51:01.628Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=934 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-11T10:51:11.269" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:01.619" grpc.time_ms=8.606 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1891gitlab # [ 258.990150] nixbot[2679]: INFO: ::ffff:127.0.0.1:35520 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1892gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.05 seconds)1893gitlab # [ 259.002838] gitaly[924]: time="2026-08-11T10:51:01.694Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=339 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-11T10:51:31.089" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:01.689" grpc.time_ms=4.306 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1894gitlab # [ 259.048217] gitaly[924]: time="2026-08-11T10:51:01.739Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T10:51:11.008" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:51:01.739" grpc.time_ms=0.217 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1895gitlab # [ 259.058145] gitaly[924]: time="2026-08-11T10:51:01.749Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-11T10:51:11.012" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-11T10:51:01.743" grpc.time_ms=5.988 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1896gitlab # [ 259.086607] gitaly[924]: time="2026-08-11T10:51:01.777Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:51:11.041" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:01.771" grpc.time_ms=6.236 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1897gitlab # [ 259.099371] gitaly[924]: time="2026-08-11T10:51:01.790Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:51:11.052" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:01.782" grpc.time_ms=8.098 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1898gitlab # [ 259.150742] gitaly[924]: time="2026-08-11T10:51:01.842Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T10:51:31.228" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:01.828" grpc.time_ms=13.306 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1899gitlab # [ 259.552735] gitaly[924]: time="2026-08-11T10:51:02.243Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-11T10:51:12.010" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:02.241" grpc.time_ms=2.353 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1900gitlab # [ 259.599359] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:02.282Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 602517e9867335656a7404cbf404a70e499058fa refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"bf0b916a9017054b7b672ce1","created_at":"2026-08-11T10:50:06.119Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-67e5b9a95793415d","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:50:06.141Z","job_size_bytes":185,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-bf0b916a9017054b7b672ce1: done: 1.027521 sec","job_status":"done","queue_duration_s":55.113202,"scheduling_latency_s":55.113267,"gitaly_calls":13,"gitaly_duration_s":0.318699,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.075307,"redis_read_bytes":2103,"redis_write_bytes":21752,"redis_cache_calls":15,"redis_cache_duration_s":0.005503,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.013103,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002589,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7840,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.007721,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.027976,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.018415,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.06,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.19,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.21,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.06,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.574479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001304355,"exclusive_lock_hold_duration_s":0.06153743,"duration_s":1.027521,"completed_at":"2026-08-11T10:51:02.282Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.103317,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1901gitlab # [ 259.671979] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:02.285Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","602517e9867335656a7404cbf404a70e499058fa 98f31e4960537ad16620ea48b0289a504b33e5c6 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"71143328c01087ceb6b329be","created_at":"2026-08-11T10:50:10.000Z","trace_propagation_headers":{"sentry-trace":"b753188eed194ff687f643fbbd700845-c97dc548e5224d88","baggage":"sentry-trace_id=b753188eed194ff687f643fbbd700845,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR73B8X8X7V1P078G7H8ZG7","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:50:10.002Z","job_size_bytes":185,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-71143328c01087ceb6b329be: start","job_status":"start","queue_duration_s":52.282909,"scheduling_latency_s":52.282962}1902gitlab # [ 259.673226] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:02.310Z","message":"changes: \"602517e9867335656a7404cbf404a70e499058fa 98f31e4960537ad16620ea48b0289a504b33e5c6 refs/heads/master\\n\""}1903gitlab # [ 259.673985] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:02.362Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"37c1a7f0880095de860c6fa2","created_at":"2026-08-11T10:51:02.360Z","trace_propagation_headers":{"sentry-trace":"b753188eed194ff687f643fbbd700845-56e418b3b6f145d6","baggage":"sentry-trace_id=b753188eed194ff687f643fbbd700845,sentry-release=Unknown"},"correlation_id":"01KZR73B8X8X7V1P078G7H8ZG7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"c9c116b414633bd8fc4e5529","job_size_bytes":46,"pid":2640,"job_status":"deduplicated","message":"ProjectCacheWorker JID-37c1a7f0880095de860c6fa2: deduplicated: until executing","deduplication.type":"until executing"}1904gitlab # [ 259.675183] gitaly[924]: time="2026-08-11T10:51:02.344Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:51:12.104" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:02.334" grpc.time_ms=9.83 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1905gitlab # [ 259.744580] gitaly[924]: time="2026-08-11T10:51:02.357Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:51:12.118" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:51:02.348" grpc.time_ms=8.904 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1906gitlab # [ 259.787448] gitaly[924]: time="2026-08-11T10:51:02.478Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-11T10:51:12.119" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:02.470" grpc.time_ms=7.876 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1907gitlab # [ 259.802434] gitaly[924]: time="2026-08-11T10:51:02.493Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-11T10:51:32.082" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:02.482" grpc.time_ms=10.704 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1908gitlab # [ 259.846953] gitaly[924]: time="2026-08-11T10:51:02.538Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=347 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-11T10:51:12.182" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-11T10:51:02.533" grpc.time_ms=4.698 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1909gitlab # [ 259.871582] gitaly[924]: time="2026-08-11T10:51:02.562Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:51:12.202" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:02.553" grpc.time_ms=9.581 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1910gitlab # [ 259.956040] gitaly[924]: time="2026-08-11T10:51:02.647Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-11T10:51:12.004" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:02.645" grpc.time_ms=1.335 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1911gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1912gitlab # [ 259.989712] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:02.680Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","602517e9867335656a7404cbf404a70e499058fa 98f31e4960537ad16620ea48b0289a504b33e5c6 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"71143328c01087ceb6b329be","created_at":"2026-08-11T10:50:10.000Z","trace_propagation_headers":{"sentry-trace":"b753188eed194ff687f643fbbd700845-c97dc548e5224d88","baggage":"sentry-trace_id=b753188eed194ff687f643fbbd700845,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR73B8X8X7V1P078G7H8ZG7","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:50:10.002Z","job_size_bytes":185,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-71143328c01087ceb6b329be: done: 0.395058 sec","job_status":"done","queue_duration_s":52.282909,"scheduling_latency_s":52.282962,"gitaly_calls":7,"gitaly_duration_s":0.10314,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.12372599999999999,"redis_read_bytes":500,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.003432,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001381,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.098782,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.009204,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.010927,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.023,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.023,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.150525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000914362,"exclusive_lock_hold_duration_s":0.021246276,"duration_s":0.395058,"completed_at":"2026-08-11T10:51:02.680Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02953,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1913gitlab # [ 259.998383] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:02.682Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ad9901251eda99a89d568c51","created_at":"2026-08-11T10:50:11.090Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-b93ac23b5a6d4abe","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-11T10:50:11.098Z","job_size_bytes":65,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ad9901251eda99a89d568c51: start","job_status":"start","queue_duration_s":51.583863,"scheduling_latency_s":51.583889}1914gitlab # [ 260.125876] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:02.816Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ad9901251eda99a89d568c51","created_at":"2026-08-11T10:50:11.090Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-b93ac23b5a6d4abe","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-11T10:50:11.098Z","job_size_bytes":65,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ad9901251eda99a89d568c51: done: 0.134563 sec","job_status":"done","queue_duration_s":51.583863,"scheduling_latency_s":51.583889,"redis_calls":16,"redis_duration_s":0.0060750000000000005,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003062,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002275,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000738,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000626337,"duration_s":0.134563,"completed_at":"2026-08-11T10:51:02.816Z","load_balancing_strategy":"primary","db_duration_s":0.02755,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1915gitlab # [ 260.128326] nixbot[2679]: INFO: ::ffff:127.0.0.1:35532 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1916gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.21 seconds)1917gitlab # [ 260.199942] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:02.890Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"73fd831ef73cafb0a50e9a4e","created_at":"2026-08-11T10:50:11.099Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-b93ac23b5a6d4abe","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-11T10:50:11.106Z","job_size_bytes":65,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-73fd831ef73cafb0a50e9a4e: start","job_status":"start","queue_duration_s":51.784076,"scheduling_latency_s":51.784114}1918gitlab # [ 260.298216] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:02.988Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"73fd831ef73cafb0a50e9a4e","created_at":"2026-08-11T10:50:11.099Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-b93ac23b5a6d4abe","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-11T10:50:11.106Z","job_size_bytes":65,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-73fd831ef73cafb0a50e9a4e: done: 0.098237 sec","job_status":"done","queue_duration_s":51.784076,"scheduling_latency_s":51.784114,"redis_calls":21,"redis_duration_s":0.007208,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002914,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002052,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002242,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049867,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000550349,"duration_s":0.098237,"completed_at":"2026-08-11T10:51:02.988Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036642,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1919gitlab # [ 260.305202] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:02.991Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"dba0dca984facf0ac34950f0","created_at":"2026-08-11T10:50:11.209Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-b93ac23b5a6d4abe","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:50:11.219Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-dba0dca984facf0ac34950f0: start","job_status":"start","queue_duration_s":51.771227,"scheduling_latency_s":51.771248}1920gitlab # [ 260.500768] gitaly[924]: time="2026-08-11T10:51:03.191Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:51:03.191" grpc.time_ms=0.411 pid=924 span.kind=server system=grpc1921gitlab # [ 260.547217] gitaly[924]: time="2026-08-11T10:51:03.238Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:51:03.237" grpc.time_ms=0.791 pid=924 span.kind=server system=grpc1922gitlab # [ 260.589113] gitaly[924]: time="2026-08-11T10:51:03.280Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:51:03.279" grpc.time_ms=0.388 pid=924 span.kind=server system=grpc1923gitlab # [ 260.614586] gitaly[924]: time="2026-08-11T10:51:03.305Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH diskcache=298c6828-8b65-4e6c-890d-cffc608fbbeb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:51:33.040" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:03.140" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1924gitlab # [ 260.630351] gitaly[924]: time="2026-08-11T10:51:03.321Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=151 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7434 command.oublock=0 command.real_time_ms=157 command.spawn_token_fork_ms=1 command.system_time_ms=85 command.user_time_ms=66 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:51:33.040" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:03.140" grpc.time_ms=165.124 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1925gitlab # [ 260.726580] gitaly[924]: time="2026-08-11T10:51:03.415Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:51:33.312" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:03.413" grpc.time_ms=1.804 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1926gitlab # [ 260.759615] gitaly[924]: time="2026-08-11T10:51:03.450Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73C6QHKPJ2X01207SY5EH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:51:33.348" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:03.449" grpc.time_ms=1.15 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1927gitlab # [ 260.783838] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:03.474Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"dba0dca984facf0ac34950f0","created_at":"2026-08-11T10:50:11.209Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-b93ac23b5a6d4abe","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:50:11.219Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2640,"job_status":"rescheduled","message":"PipelineProcessWorker JID-dba0dca984facf0ac34950f0: rescheduled"}1928gitlab # [ 260.800527] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:03.491Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"dba0dca984facf0ac34950f0","created_at":"2026-08-11T10:50:11.209Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-b93ac23b5a6d4abe","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:50:11.219Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-dba0dca984facf0ac34950f0: done: 0.500227 sec","job_status":"done","queue_duration_s":51.771227,"scheduling_latency_s":51.771248,"gitaly_calls":3,"gitaly_duration_s":0.178615,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.044425,"redis_read_bytes":462,"redis_write_bytes":29297,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001942,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001811,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.01565,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.006409,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15584,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.010172,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001215,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001099,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004185,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.079,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.021,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.025,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.034,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.19861,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.425581463,"duration_s":0.500227,"completed_at":"2026-08-11T10:51:03.491Z","load_balancing_strategy":"primary","db_duration_s":0.0918,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1929gitlab # [ 260.874161] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:03.494Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"c9c116b414633bd8fc4e5529","created_at":"2026-08-11T10:51:01.409Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-cd1cf027c6004942","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:01.428Z","job_size_bytes":46,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-c9c116b414633bd8fc4e5529: start","job_status":"start","queue_duration_s":2.065496,"scheduling_latency_s":2.065537}1930gitlab # [ 260.875343] gitaly[924]: time="2026-08-11T10:51:03.544Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-11T16:51:03.537" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:51:03.538" grpc.time_ms=5.861 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1931gitlab # [ 260.876313] gitaly[924]: time="2026-08-11T10:51:03.561Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-11T10:51:33.452" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:03.553" grpc.time_ms=7.677 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1932gitlab # [ 260.943605] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:03.587Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"c9c116b414633bd8fc4e5529","created_at":"2026-08-11T10:51:01.409Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-cd1cf027c6004942","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:01.428Z","job_size_bytes":46,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-c9c116b414633bd8fc4e5529: done: 0.093404 sec","job_status":"done","queue_duration_s":2.065496,"scheduling_latency_s":2.065537,"gitaly_calls":2,"gitaly_duration_s":0.019529,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.01214,"redis_read_bytes":69,"redis_write_bytes":4883,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002437,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000922,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002911,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004589,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001281,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00060734,"duration_s":0.093404,"completed_at":"2026-08-11T10:51:03.587Z","load_balancing_strategy":"primary","db_duration_s":0.014043,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1933gitlab # [ 261.021283] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:03.589Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"bbd53ea7299ea06cc27cd540","created_at":"2026-08-11T10:51:01.443Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-cd1cf027c6004942","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:01.448Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-bbd53ea7299ea06cc27cd540: start","job_status":"start","queue_duration_s":2.141293,"scheduling_latency_s":2.141315}1934gitlab # [ 261.022928] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:03.689Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"bbd53ea7299ea06cc27cd540","created_at":"2026-08-11T10:51:01.443Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-cd1cf027c6004942","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:01.448Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-bbd53ea7299ea06cc27cd540: done: 0.099926 sec","job_status":"done","queue_duration_s":2.141293,"scheduling_latency_s":2.141315,"gitaly_calls":1,"gitaly_duration_s":0.030642,"redis_calls":15,"redis_duration_s":0.008239,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000834,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004611,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00121,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001584,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.013,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.023,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.072948936,"duration_s":0.099926,"completed_at":"2026-08-11T10:51:03.689Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014886,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1935gitlab # [ 261.093794] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:03.691Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"d7e92c2d2021a8d9024f93ee","created_at":"2026-08-11T10:51:01.611Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-cd1cf027c6004942","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:01.612Z","job_size_bytes":23,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d7e92c2d2021a8d9024f93ee: start","job_status":"start","queue_duration_s":2.078273,"scheduling_latency_s":2.078295}1936gitlab # [ 261.095156] gitaly[924]: time="2026-08-11T10:51:03.639Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH diskcache=280dcd7b-bd04-40cb-910d-e68f1cff1c0a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T16:51:03.611" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:03.611" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1938gitlab # [ 261.095932] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:03.726Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"d7e92c2d2021a8d9024f93ee","created_at":"2026-08-11T10:51:01.611Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-cd1cf027c6004942","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:01.612Z","job_size_bytes":23,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d7e92c2d2021a8d9024f93ee: done: 0.035812 sec","job_status":"done","queue_duration_s":2.078273,"scheduling_latency_s":2.078295,"gitaly_calls":1,"gitaly_duration_s":0.008613,"redis_calls":16,"redis_duration_s":0.0035110000000000002,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000248,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001043,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001618,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000602,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035812,"completed_at":"2026-08-11T10:51:03.726Z","load_balancing_strategy":"primary","db_duration_s":0.002081,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1939gitlab # [ 261.195092] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:03.728Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"fe1bc2c469cc0eec202ab0e8","created_at":"2026-08-11T10:51:02.081Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-cd1cf027c6004942","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7f4cf8bbc14bbb15c872fcecd78ce092c3b2c278d3c3b41ea5c813c00afe9fbe","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:02.092Z","job_size_bytes":467,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-fe1bc2c469cc0eec202ab0e8: start","job_status":"start","queue_duration_s":1.63586,"scheduling_latency_s":1.635881}1940gitlab # [ 261.196377] gitaly[924]: time="2026-08-11T10:51:03.640Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1287 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T16:51:03.611" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:03.611" grpc.time_ms=28.016 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1941gitlab # [ 261.263233] gitaly[924]: time="2026-08-11T10:51:03.719Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=654 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-11T10:51:33.612" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:03.713" grpc.time_ms=6.537 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1942gitlab # [ 261.264866] gitaly[924]: time="2026-08-11T10:51:03.749Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:51:33.648" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:03.748" grpc.time_ms=0.568 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1943gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.13 seconds)1944gitlab # [ 261.266149] gitaly[924]: time="2026-08-11T10:51:03.758Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T10:51:13.112" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:03.752" grpc.time_ms=6.093 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1945gitlab # [ 261.272284] gitaly[924]: time="2026-08-11T10:51:03.839Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:51:33.738" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:03.838" grpc.time_ms=1.009 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1946gitlab # [ 261.340338] gitaly[924]: time="2026-08-11T10:51:03.844Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=97 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-11T10:51:33.741" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:03.842" grpc.time_ms=2.275 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1947gitlab # [ 261.342133] nixbot[2679]: INFO: ::ffff:127.0.0.1:35540 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1948gitlab # [ 261.343157] gitaly[924]: time="2026-08-11T10:51:03.909Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:51:13.262" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:03.902" grpc.time_ms=6.898 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab # [ 261.686916] gitaly[924]: time="2026-08-11T10:51:04.377Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T10:51:34.256" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:04.356" grpc.time_ms=21.001 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1950gitlab # [ 261.738427] gitaly[924]: time="2026-08-11T10:51:04.398Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR737ADP5323Q3EYJCM1VGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-11T10:51:34.280" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:04.380" grpc.time_ms=17.336 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1951gitlab # [ 261.758855] sidekiq-cluster[2640]: {"severity":"WARN","time":"2026-08-11T10:51:04.422Z","class":"CreatePipelineWorker","correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"602517e9867335656a7404cbf404a70e499058fa","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"602517e9867335656a7404cbf404a70e499058fa","ref":"refs/heads/master"},"retry":0}1952gitlab # [ 261.770084] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:04.428Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"fe1bc2c469cc0eec202ab0e8","created_at":"2026-08-11T10:51:02.081Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-cd1cf027c6004942","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7f4cf8bbc14bbb15c872fcecd78ce092c3b2c278d3c3b41ea5c813c00afe9fbe","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:02.092Z","job_size_bytes":467,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-fe1bc2c469cc0eec202ab0e8: done: 0.700627 sec","job_status":"done","queue_duration_s":1.63586,"scheduling_latency_s":1.635881,"gitaly_calls":7,"gitaly_duration_s":0.071987,"redis_calls":51,"redis_duration_s":0.012006,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000838,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.00503,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001827,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002916,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001395,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.567251,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000608457,"duration_s":0.700627,"completed_at":"2026-08-11T10:51:04.428Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042855,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1953gitlab # [ 261.841361] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:04.431Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"36ee5a27-3917-4cff-b99d-a173da6d3ea2\"}"],"class":"WebHookWorker","jid":"97683637fb1dc00266697998","created_at":"2026-08-11T10:51:02.212Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-cd1cf027c6004942","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:070f5ed0f0436a834ed71853f993bff0ae8f7ff1ebcd81ee87c3520aab7f0a0f","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:02.218Z","job_size_bytes":1751,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-97683637fb1dc00266697998: start","job_status":"start","queue_duration_s":2.212387,"scheduling_latency_s":2.212409}1954gitlab # [ 261.848345] nixbot[2679]: INFO: ::ffff:127.0.0.1:35552 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1955gitlab # [ 261.867755] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:04.558Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"36ee5a27-3917-4cff-b99d-a173da6d3ea2\"}"],"class":"WebHookWorker","jid":"97683637fb1dc00266697998","created_at":"2026-08-11T10:51:02.212Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-cd1cf027c6004942","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:070f5ed0f0436a834ed71853f993bff0ae8f7ff1ebcd81ee87c3520aab7f0a0f","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:02.218Z","job_size_bytes":1751,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-97683637fb1dc00266697998: done: 0.127425 sec","job_status":"done","queue_duration_s":2.212387,"scheduling_latency_s":2.212409,"redis_calls":19,"redis_duration_s":0.005063,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001193,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000314,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002318,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001238,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.032885743999997885,"cpu_s":0.078207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000396977,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.127425,"completed_at":"2026-08-11T10:51:04.558Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004496,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1956gitlab # [ 261.882750] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:04.560Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"d55c76df128bc72b9d5d253b","created_at":"2026-08-11T10:51:02.368Z","trace_propagation_headers":{"sentry-trace":"b753188eed194ff687f643fbbd700845-56e418b3b6f145d6","baggage":"sentry-trace_id=b753188eed194ff687f643fbbd700845,sentry-release=Unknown"},"correlation_id":"01KZR73B8X8X7V1P078G7H8ZG7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"bbd53ea7299ea06cc27cd540","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:02.465Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-d55c76df128bc72b9d5d253b: start","job_status":"start","queue_duration_s":2.094723,"scheduling_latency_s":2.094745}1957gitlab # [ 261.973449] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:04.598Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"d55c76df128bc72b9d5d253b","created_at":"2026-08-11T10:51:02.368Z","trace_propagation_headers":{"sentry-trace":"b753188eed194ff687f643fbbd700845-56e418b3b6f145d6","baggage":"sentry-trace_id=b753188eed194ff687f643fbbd700845,sentry-release=Unknown"},"correlation_id":"01KZR73B8X8X7V1P078G7H8ZG7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"bbd53ea7299ea06cc27cd540","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:02.465Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-d55c76df128bc72b9d5d253b: done: 0.038743 sec","job_status":"done","queue_duration_s":2.094723,"scheduling_latency_s":2.094745,"gitaly_calls":1,"gitaly_duration_s":0.012442,"redis_calls":12,"redis_duration_s":0.002718,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001112,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000616,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.022561247,"duration_s":0.038743,"completed_at":"2026-08-11T10:51:04.598Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003944,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1958gitlab # [ 262.042193] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:04.600Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"2f79b8f78fe3e791220c7d40","created_at":"2026-08-11T10:51:02.617Z","trace_propagation_headers":{"sentry-trace":"b753188eed194ff687f643fbbd700845-56e418b3b6f145d6","baggage":"sentry-trace_id=b753188eed194ff687f643fbbd700845,sentry-release=Unknown"},"correlation_id":"01KZR73B8X8X7V1P078G7H8ZG7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ac808d112893f9c30af6d79da2fa869ebb64470a362d7f4cd498e8202da9e9fd","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:02.619Z","job_size_bytes":467,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-2f79b8f78fe3e791220c7d40: start","job_status":"start","queue_duration_s":1.980969,"scheduling_latency_s":1.980989}1959gitlab # [ 262.043767] gitaly[924]: time="2026-08-11T10:51:04.586Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 diskcache=aaadf6ca-54ef-4ee2-91cc-7aeaac74513f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T16:51:04.576" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:04.576" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1960gitlab # [ 262.044762] gitaly[924]: time="2026-08-11T10:51:04.586Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T16:51:04.576" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:04.576" grpc.time_ms=9.839 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1961gitlab # [ 262.045931] gitaly[924]: time="2026-08-11T10:51:04.619Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:51:34.518" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:04.618" grpc.time_ms=0.505 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1962gitlab # [ 262.117331] gitaly[924]: time="2026-08-11T10:51:04.627Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T10:51:14.000" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:04.621" grpc.time_ms=6.214 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1963gitlab # [ 262.118797] gitaly[924]: time="2026-08-11T10:51:04.655Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:51:34.554" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:04.654" grpc.time_ms=0.748 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1964gitlab # [ 262.119908] gitaly[924]: time="2026-08-11T10:51:04.660Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=51 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-11T10:51:34.557" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:04.658" grpc.time_ms=1.75 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1965gitlab # [ 262.187363] gitaly[924]: time="2026-08-11T10:51:04.685Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:51:14.039" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:04.679" grpc.time_ms=5.486 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1966gitlab # [ 262.282516] gitaly[924]: time="2026-08-11T10:51:04.973Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR751ATQ5JENAF1E6WS84DT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:04.963" grpc.time_ms=10.047 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1967gitlab # [ 262.284747] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:04 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 521968gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1969gitlab # [ 262.322560] gitaly[924]: time="2026-08-11T10:51:05.013Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=11 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T10:51:34.886" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:04.986" grpc.time_ms=26.826 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1970gitlab # [ 262.356231] nixbot[2679]: INFO: ::ffff:127.0.0.1:35568 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK1971gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.03 seconds)1972gitlab # [ 262.361685] gitaly[924]: time="2026-08-11T10:51:05.052Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=5 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR73B8X8X7V1P078G7H8ZG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-11T10:51:35.040" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:05.040" grpc.time_ms=12.059 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1973gitlab # [ 262.371896] sidekiq-cluster[2640]: {"severity":"WARN","time":"2026-08-11T10:51:05.063Z","class":"CreatePipelineWorker","correlation_id":"01KZR73B8X8X7V1P078G7H8ZG7","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"602517e9867335656a7404cbf404a70e499058fa","after":"98f31e4960537ad16620ea48b0289a504b33e5c6","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"98f31e4960537ad16620ea48b0289a504b33e5c6","ref":"refs/heads/master"},"retry":0}1974gitlab # [ 262.376782] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.067Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"2f79b8f78fe3e791220c7d40","created_at":"2026-08-11T10:51:02.617Z","trace_propagation_headers":{"sentry-trace":"b753188eed194ff687f643fbbd700845-56e418b3b6f145d6","baggage":"sentry-trace_id=b753188eed194ff687f643fbbd700845,sentry-release=Unknown"},"correlation_id":"01KZR73B8X8X7V1P078G7H8ZG7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ac808d112893f9c30af6d79da2fa869ebb64470a362d7f4cd498e8202da9e9fd","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:02.619Z","job_size_bytes":467,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-2f79b8f78fe3e791220c7d40: done: 0.467561 sec","job_status":"done","queue_duration_s":1.980969,"scheduling_latency_s":1.980989,"gitaly_calls":7,"gitaly_duration_s":0.09217,"redis_calls":33,"redis_duration_s":0.005255,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000684,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002423,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.352959,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.467561,"completed_at":"2026-08-11T10:51:05.067Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015991,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1975gitlab # [ 262.451199] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.069Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"7e4b746b-8532-47bd-b414-0ba3c1326673\"}"],"class":"WebHookWorker","jid":"93d5b0292c8dd22443f2b714","created_at":"2026-08-11T10:51:02.632Z","trace_propagation_headers":{"sentry-trace":"b753188eed194ff687f643fbbd700845-56e418b3b6f145d6","baggage":"sentry-trace_id=b753188eed194ff687f643fbbd700845,sentry-release=Unknown"},"correlation_id":"01KZR73B8X8X7V1P078G7H8ZG7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2bda4d9f9b32235ba1f4c1493298727541bfe931dc1cb1e675a98949805c5c82","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:02.633Z","job_size_bytes":1749,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-93d5b0292c8dd22443f2b714: start","job_status":"start","queue_duration_s":2.435693,"scheduling_latency_s":2.435765}1976gitlab # [ 262.452278] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.104Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"7e4b746b-8532-47bd-b414-0ba3c1326673\"}"],"class":"WebHookWorker","jid":"93d5b0292c8dd22443f2b714","created_at":"2026-08-11T10:51:02.632Z","trace_propagation_headers":{"sentry-trace":"b753188eed194ff687f643fbbd700845-56e418b3b6f145d6","baggage":"sentry-trace_id=b753188eed194ff687f643fbbd700845,sentry-release=Unknown"},"correlation_id":"01KZR73B8X8X7V1P078G7H8ZG7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2bda4d9f9b32235ba1f4c1493298727541bfe931dc1cb1e675a98949805c5c82","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:02.633Z","job_size_bytes":1749,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-93d5b0292c8dd22443f2b714: done: 0.034652 sec","job_status":"done","queue_duration_s":2.435693,"scheduling_latency_s":2.435765,"redis_calls":14,"redis_duration_s":0.004395,"redis_read_bytes":26,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.000325,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003058,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.0060471379999853525,"cpu_s":0.018751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.034652,"completed_at":"2026-08-11T10:51:05.104Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001962,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1977gitlab # [ 262.528289] nixbot[2679]: INFO: ::ffff:127.0.0.1:35574 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1978gitlab # [ 262.530080] gitaly[924]: time="2026-08-11T10:51:05.084Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR751CJ1V5V2ZMHHKVT4Q9K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:05.076" pid=924 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1979gitlab # [ 262.531387] gitlab-workhorse[824]: time="2026-08-11T10:51:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671980gitlab # [ 262.532229] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:05 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1071981gitlab # [ 262.533718] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.105Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"21d7bd47f5bc2957d3d47786","created_at":"2026-08-11T10:51:03.108Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.119Z","job_size_bytes":23,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-21d7bd47f5bc2957d3d47786: start","job_status":"start","queue_duration_s":1.986531,"scheduling_latency_s":1.986553}1982gitlab # [ 262.602089] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.170Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"21d7bd47f5bc2957d3d47786","created_at":"2026-08-11T10:51:03.108Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.119Z","job_size_bytes":23,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-21d7bd47f5bc2957d3d47786: done: 0.065336 sec","job_status":"done","queue_duration_s":1.986531,"scheduling_latency_s":1.986553,"redis_calls":10,"redis_duration_s":0.002205,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000425,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001356,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000424,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000394463,"duration_s":0.065336,"completed_at":"2026-08-11T10:51:05.170Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017234,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1983gitlab # [ 262.612939] gitaly[924]: time="2026-08-11T10:51:05.085Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR751CJ1V5V2ZMHHKVT4Q9K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:05.076" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1984gitlab # [ 262.693243] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.172Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"252fbc4c2c0f902fc7486a18","created_at":"2026-08-11T10:51:03.311Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.316Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-252fbc4c2c0f902fc7486a18: start","job_status":"start","queue_duration_s":1.856164,"scheduling_latency_s":1.856186}1985gitlab # [ 262.694401] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.199Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"252fbc4c2c0f902fc7486a18","created_at":"2026-08-11T10:51:03.311Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.316Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-252fbc4c2c0f902fc7486a18: done: 0.026968 sec","job_status":"done","queue_duration_s":1.856164,"scheduling_latency_s":1.856186,"redis_calls":10,"redis_duration_s":0.002135,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00041,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001307,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000341384,"duration_s":0.026968,"completed_at":"2026-08-11T10:51:05.199Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003812,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1986gitlab # [ 262.768513] gitaly[924]: time="2026-08-11T10:51:05.085Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR751CJ1V5V2ZMHHKVT4Q9K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:05.076" grpc.time_ms=8.7 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc1987gitlab # [ 262.770354] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.200Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"89f749a69ddcd18ead312dbb","created_at":"2026-08-11T10:51:03.327Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.336Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-89f749a69ddcd18ead312dbb: start","job_status":"start","queue_duration_s":1.863897,"scheduling_latency_s":1.863916}1988gitlab # [ 262.772919] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.231Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"89f749a69ddcd18ead312dbb","created_at":"2026-08-11T10:51:03.327Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.336Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-89f749a69ddcd18ead312dbb: done: 0.031206 sec","job_status":"done","queue_duration_s":1.863897,"scheduling_latency_s":1.863916,"redis_calls":10,"redis_duration_s":0.00366,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000518,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002745,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000397,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038273,"duration_s":0.031206,"completed_at":"2026-08-11T10:51:05.231Z","load_balancing_strategy":"primary","db_duration_s":0.007005,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1989gitlab # [ 262.854396] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.233Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"8e685caca2a23696ba12210c","created_at":"2026-08-11T10:51:03.348Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.352Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8e685caca2a23696ba12210c: start","job_status":"start","queue_duration_s":1.880397,"scheduling_latency_s":1.880475}1990gitlab # [ 262.921337] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.324Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"8e685caca2a23696ba12210c","created_at":"2026-08-11T10:51:03.348Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.352Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8e685caca2a23696ba12210c: done: 0.091072 sec","job_status":"done","queue_duration_s":1.880397,"scheduling_latency_s":1.880475,"redis_calls":13,"redis_duration_s":0.002846,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000492,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001281,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000674,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000399,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000342501,"duration_s":0.091072,"completed_at":"2026-08-11T10:51:05.324Z","load_balancing_strategy":"primary","db_duration_s":0.003962,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1991gitlab # [ 262.931922] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.326Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"b0907755e47e33c62525989f","created_at":"2026-08-11T10:51:03.353Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.357Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-b0907755e47e33c62525989f: start","job_status":"start","queue_duration_s":1.968944,"scheduling_latency_s":1.968969}1992gitlab # [ 263.000228] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.354Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"b0907755e47e33c62525989f","created_at":"2026-08-11T10:51:03.353Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.357Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-b0907755e47e33c62525989f: done: 0.028891 sec","job_status":"done","queue_duration_s":1.968944,"scheduling_latency_s":1.968969,"redis_calls":10,"redis_duration_s":0.002251,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000466,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001359,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000426,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000355631,"duration_s":0.028891,"completed_at":"2026-08-11T10:51:05.354Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004075,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1993gitlab # [ 263.085325] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.356Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6a2a2b929bd81c6b434a9ea5","created_at":"2026-08-11T10:51:03.357Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.361Z","job_size_bytes":19,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6a2a2b929bd81c6b434a9ea5: start","job_status":"start","queue_duration_s":1.994577,"scheduling_latency_s":1.994598}1994gitlab # [ 263.086780] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.380Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6a2a2b929bd81c6b434a9ea5","created_at":"2026-08-11T10:51:03.357Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.361Z","job_size_bytes":19,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6a2a2b929bd81c6b434a9ea5: done: 0.024265 sec","job_status":"done","queue_duration_s":1.994577,"scheduling_latency_s":1.994598,"redis_calls":11,"redis_duration_s":0.002418,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000471,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00154,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000407,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034725,"duration_s":0.024265,"completed_at":"2026-08-11T10:51:05.380Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002823,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1995gitlab # [ 263.174597] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.381Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"083f510ac2aca11582f2a758","created_at":"2026-08-11T10:51:03.364Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.368Z","job_size_bytes":66,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-083f510ac2aca11582f2a758: start","job_status":"start","queue_duration_s":2.013667,"scheduling_latency_s":2.013687}1996gitlab # [ 263.175883] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.410Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"083f510ac2aca11582f2a758","created_at":"2026-08-11T10:51:03.364Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.368Z","job_size_bytes":66,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-083f510ac2aca11582f2a758: done: 0.028381 sec","job_status":"done","queue_duration_s":2.013667,"scheduling_latency_s":2.013687,"redis_calls":10,"redis_duration_s":0.004485,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000829,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002937,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000719,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035647,"duration_s":0.028381,"completed_at":"2026-08-11T10:51:05.410Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1997gitlab # [ 263.247390] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.411Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"14473446362cff3e1a19671f","created_at":"2026-08-11T10:51:03.369Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.373Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-14473446362cff3e1a19671f: start","job_status":"start","queue_duration_s":2.038171,"scheduling_latency_s":2.038191}1998gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'1999gitlab # [ 263.248803] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.442Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"14473446362cff3e1a19671f","created_at":"2026-08-11T10:51:03.369Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.373Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-14473446362cff3e1a19671f: done: 0.031087 sec","job_status":"done","queue_duration_s":2.038171,"scheduling_latency_s":2.038191,"redis_calls":10,"redis_duration_s":0.002216,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000403,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001304,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000509,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000357307,"duration_s":0.031087,"completed_at":"2026-08-11T10:51:05.442Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2000gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.03 seconds)2001gitlab # [ 263.332157] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.444Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e9953481164a2eb57138b2c9","created_at":"2026-08-11T10:51:03.379Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.383Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e9953481164a2eb57138b2c9: start","job_status":"start","queue_duration_s":2.060682,"scheduling_latency_s":2.060703}2002gitlab # [ 263.333320] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.482Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e9953481164a2eb57138b2c9","created_at":"2026-08-11T10:51:03.379Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.383Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e9953481164a2eb57138b2c9: done: 0.038854 sec","job_status":"done","queue_duration_s":2.060682,"scheduling_latency_s":2.060703,"redis_calls":10,"redis_duration_s":0.004860000000000001,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000455,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003988,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000417,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000392508,"duration_s":0.038854,"completed_at":"2026-08-11T10:51:05.482Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014271,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2003gitlab # [ 263.400267] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.484Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"af80201ec689e64cf2da4e65","created_at":"2026-08-11T10:51:03.383Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.387Z","job_size_bytes":6,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-af80201ec689e64cf2da4e65: start","job_status":"start","queue_duration_s":2.096885,"scheduling_latency_s":2.096905}2004gitlab # [ 263.469218] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.504Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"af80201ec689e64cf2da4e65","created_at":"2026-08-11T10:51:03.383Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.387Z","job_size_bytes":6,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-af80201ec689e64cf2da4e65: done: 0.019972 sec","job_status":"done","queue_duration_s":2.096885,"scheduling_latency_s":2.096905,"redis_calls":10,"redis_duration_s":0.0026769999999999997,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000449,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001816,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000349765,"duration_s":0.019972,"completed_at":"2026-08-11T10:51:05.504Z","load_balancing_strategy":"primary","db_duration_s":0.001568,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2005gitlab # [ 263.538763] nixbot[2679]: INFO: ::ffff:127.0.0.1:41450 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK2006gitlab # [ 263.539835] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.505Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"32d8c326e9f79eb1479fcb04","created_at":"2026-08-11T10:51:03.388Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.392Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-32d8c326e9f79eb1479fcb04: start","job_status":"start","queue_duration_s":2.113558,"scheduling_latency_s":2.113578}2007gitlab # [ 263.540897] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.534Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"32d8c326e9f79eb1479fcb04","created_at":"2026-08-11T10:51:03.388Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.392Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-32d8c326e9f79eb1479fcb04: done: 0.028325 sec","job_status":"done","queue_duration_s":2.113558,"scheduling_latency_s":2.113578,"redis_calls":10,"redis_duration_s":0.002242,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000453,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001338,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000451,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000374908,"duration_s":0.028325,"completed_at":"2026-08-11T10:51:05.534Z","load_balancing_strategy":"primary","db_duration_s":0.005017,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2008gitlab # [ 263.610041] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.535Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"c74953df875c1023dce9042a","created_at":"2026-08-11T10:51:03.398Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.402Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-c74953df875c1023dce9042a: start","job_status":"start","queue_duration_s":2.133261,"scheduling_latency_s":2.133282}2009gitlab # [ 263.610748] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.588Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"c74953df875c1023dce9042a","created_at":"2026-08-11T10:51:03.398Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.402Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-c74953df875c1023dce9042a: done: 0.052932 sec","job_status":"done","queue_duration_s":2.133261,"scheduling_latency_s":2.133282,"redis_calls":14,"redis_duration_s":0.004455,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001395,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001777,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001283,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000661537,"duration_s":0.052932,"completed_at":"2026-08-11T10:51:05.588Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010499,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2010gitlab # [ 263.679114] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.589Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"df916e631f585fd8f435bcac","created_at":"2026-08-11T10:51:03.475Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.478Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-df916e631f585fd8f435bcac: start","job_status":"start","queue_duration_s":2.111656,"scheduling_latency_s":2.111677}2011gitlab # [ 263.750281] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.612Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"df916e631f585fd8f435bcac","created_at":"2026-08-11T10:51:03.475Z","trace_propagation_headers":{"sentry-trace":"e43b76e5933a4b0598f869246baf8e3c-5ab6931f26d643b8","baggage":"sentry-trace_id=e43b76e5933a4b0598f869246baf8e3c,sentry-release=Unknown"},"correlation_id":"01KZR73C6QHKPJ2X01207SY5EH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.478Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-df916e631f585fd8f435bcac: done: 0.022853 sec","job_status":"done","queue_duration_s":2.111656,"scheduling_latency_s":2.111677,"redis_calls":8,"redis_duration_s":0.001709,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001278,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000431,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022853,"completed_at":"2026-08-11T10:51:05.612Z","load_balancing_strategy":"primary","db_duration_s":0.002904,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2012gitlab # [ 263.757214] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.615Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"1fe75f334b92d7cc04909475","created_at":"2026-08-11T10:51:03.571Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-7b21565bc6274e7d","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.576Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-1fe75f334b92d7cc04909475: start","job_status":"start","queue_duration_s":2.039267,"scheduling_latency_s":2.039288}2013gitlab # [ 263.826455] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.655Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"1fe75f334b92d7cc04909475","created_at":"2026-08-11T10:51:03.571Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-7b21565bc6274e7d","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:03.576Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-1fe75f334b92d7cc04909475: done: 0.039307 sec","job_status":"done","queue_duration_s":2.039267,"scheduling_latency_s":2.039288,"redis_calls":19,"redis_duration_s":0.005547,"redis_read_bytes":21,"redis_write_bytes":4288,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001411,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000453,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2259,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002819,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000864,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006495519,"duration_s":0.039307,"completed_at":"2026-08-11T10:51:05.655Z","load_balancing_strategy":"primary","db_duration_s":0.005495,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2014gitlab # [ 263.895717] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.656Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","97683637fb1dc00266697998"],"class":"WebHooks::LogExecutionWorker","jid":"144a138bfbf5e372fbd961a5","created_at":"2026-08-11T10:51:04.544Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-d90e1b25a58d4901","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e4828e5f1da193fadd20e4c863f130b9cc06c71a28e0a4ff6e431ba1f29a6d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:04.552Z","job_size_bytes":2593,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-144a138bfbf5e372fbd961a5: start","job_status":"start","queue_duration_s":1.104897,"scheduling_latency_s":1.104926}2015gitlab # [ 263.897005] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.692Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","97683637fb1dc00266697998"],"class":"WebHooks::LogExecutionWorker","jid":"144a138bfbf5e372fbd961a5","created_at":"2026-08-11T10:51:04.544Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-d90e1b25a58d4901","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e4828e5f1da193fadd20e4c863f130b9cc06c71a28e0a4ff6e431ba1f29a6d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:04.552Z","job_size_bytes":2593,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-144a138bfbf5e372fbd961a5: done: 0.0354 sec","job_status":"done","queue_duration_s":1.104897,"scheduling_latency_s":1.104926,"redis_calls":10,"redis_duration_s":0.002078,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000384,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001262,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000432,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000348927,"duration_s":0.0354,"completed_at":"2026-08-11T10:51:05.692Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006484,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2016gitlab # [ 263.968108] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.695Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","93d5b0292c8dd22443f2b714"],"class":"WebHooks::LogExecutionWorker","jid":"298c14c7085a1d9d68c6ead6","created_at":"2026-08-11T10:51:05.096Z","trace_propagation_headers":{"sentry-trace":"b753188eed194ff687f643fbbd700845-135fb2b9aa8e4370","baggage":"sentry-trace_id=b753188eed194ff687f643fbbd700845,sentry-release=Unknown"},"correlation_id":"01KZR73B8X8X7V1P078G7H8ZG7","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a89c40eabc7b14c9745997b370620e9da273f00bb8fe596d0d3c8f308dfbf10d","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:05.099Z","job_size_bytes":2591,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-298c14c7085a1d9d68c6ead6: start","job_status":"start","queue_duration_s":0.595524,"scheduling_latency_s":0.595545}2017gitlab # [ 263.968720] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.721Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","93d5b0292c8dd22443f2b714"],"class":"WebHooks::LogExecutionWorker","jid":"298c14c7085a1d9d68c6ead6","created_at":"2026-08-11T10:51:05.096Z","trace_propagation_headers":{"sentry-trace":"b753188eed194ff687f643fbbd700845-135fb2b9aa8e4370","baggage":"sentry-trace_id=b753188eed194ff687f643fbbd700845,sentry-release=Unknown"},"correlation_id":"01KZR73B8X8X7V1P078G7H8ZG7","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a89c40eabc7b14c9745997b370620e9da273f00bb8fe596d0d3c8f308dfbf10d","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:05.099Z","job_size_bytes":2591,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-298c14c7085a1d9d68c6ead6: done: 0.026676 sec","job_status":"done","queue_duration_s":0.595524,"scheduling_latency_s":0.595545,"redis_calls":7,"redis_duration_s":0.003805,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002986,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000819,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026676,"completed_at":"2026-08-11T10:51:05.721Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006101,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2018gitlab # [ 264.045000] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.723Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"1121e255098dced1d94f82f0","created_at":"2026-08-11T10:51:05.643Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-eb0952c8d5ce48db","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:05.648Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-1121e255098dced1d94f82f0: start","job_status":"start","queue_duration_s":0.075127,"scheduling_latency_s":0.075149}2019gitlab # [ 264.114123] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:05.799Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"1121e255098dced1d94f82f0","created_at":"2026-08-11T10:51:05.643Z","trace_propagation_headers":{"sentry-trace":"fe82cbee53f44a0a94597733d2f3c2d0-eb0952c8d5ce48db","baggage":"sentry-trace_id=fe82cbee53f44a0a94597733d2f3c2d0,sentry-release=Unknown"},"correlation_id":"01KZR737ADP5323Q3EYJCM1VGH","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:05.648Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-1121e255098dced1d94f82f0: done: 0.075959 sec","job_status":"done","queue_duration_s":0.075127,"scheduling_latency_s":0.075149,"redis_calls":11,"redis_duration_s":0.0070279999999999995,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000419,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.005671,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000363454,"duration_s":0.075959,"completed_at":"2026-08-11T10:51:05.799Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022572,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2020gitlab # [ 264.219187] nixbot[2679]: {"ts": "2026-08-11T10:51:06.910Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2021gitlab # [ 264.272642] gitaly[924]: time="2026-08-11T10:51:06.963Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR7538Y6V14K220P8S3YA19 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:06.957" grpc.time_ms=6.177 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc2022gitlab # [ 264.274137] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:06 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 532023gitlab # [ 264.328732] gitaly[924]: time="2026-08-11T10:51:07.020Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:51:37.018" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:07.019" grpc.time_ms=0.663 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2024gitlab # [ 264.356234] gitaly[924]: time="2026-08-11T10:51:07.047Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR753BCAVNQMPCGJJDER3T6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:07.039" pid=924 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2025gitlab # [ 264.357324] gitaly[924]: time="2026-08-11T10:51:07.047Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR753BCAVNQMPCGJJDER3T6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:07.039" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc2026gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'2027gitlab # [ 264.358160] gitaly[924]: time="2026-08-11T10:51:07.047Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR753BCAVNQMPCGJJDER3T6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:07.039" grpc.time_ms=7.744 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc2028gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 0.03 seconds)2029gitlab # [ 264.375919] gitaly[924]: time="2026-08-11T10:51:07.067Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:51:17.000" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:07.061" grpc.time_ms=5.939 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2030gitlab # [ 264.420174] nixbot[2679]: INFO: ::ffff:127.0.0.1:41462 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK2031gitlab # [ 264.437939] gitlab-workhorse[824]: time="2026-08-11T10:51:07Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672032gitlab # [ 264.441243] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:07 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1392033gitlab # [ 264.494396] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:07.185Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0858e5882d4002d46e197c15","created_at":"2026-08-11T10:51:07.175Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-6a25c627a15f44da","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.183Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0858e5882d4002d46e197c15: start","job_status":"start","queue_duration_s":0.001981,"scheduling_latency_s":0.002017}2034gitlab # [ 264.506936] nixbot[2679]: {"ts": "2026-08-11T10:51:07.197Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/602517e9867335656a7404cbf404a70e499058fa \"HTTP/1.1 201 Created\""}2035gitlab # [ 264.508144] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/602517e9867335656a7404cbf404a70e499058fa HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2772036gitlab # [ 264.553983] gitaly[924]: time="2026-08-11T10:51:07.245Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR753GNSXNBFG3RPB8GY15X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:07.237" grpc.time_ms=7.288 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc2037gitlab # [ 264.557785] gitaly[924]: time="2026-08-11T10:51:07.249Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR753J3AEWPC8CSRZZATKHG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:51:37.248" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:07.248" grpc.time_ms=0.486 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2038gitlab # [ 264.560667] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:07 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 932039gitlab # [ 264.600060] gitaly[924]: time="2026-08-11T10:51:07.291Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR753J3AEWPC8CSRZZATKHG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:51:17.222" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:07.283" grpc.time_ms=8.014 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2040gitlab # [ 264.622399] gitaly[924]: time="2026-08-11T10:51:07.313Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:51:07.313" grpc.time_ms=0.393 pid=924 span.kind=server system=grpc2041gitlab # [ 264.652662] gitaly[924]: time="2026-08-11T10:51:07.343Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR753M615RJEQ5H96NMPJ52 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:07.329" pid=924 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2042gitlab # [ 264.653456] gitaly[924]: time="2026-08-11T10:51:07.343Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1164 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR753M615RJEQ5H96NMPJ52 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:07.329" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc2043gitlab # [ 264.660889] nixbot[2679]: {"ts": "2026-08-11T10:51:07.351Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/602517e9867335656a7404cbf404a70e499058fa \"HTTP/1.1 201 Created\""}2044gitlab # [ 264.662104] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/602517e9867335656a7404cbf404a70e499058fa HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1472045gitlab # [ 264.665963] gitaly[924]: time="2026-08-11T10:51:07.357Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:51:07.356" grpc.time_ms=0.36 pid=924 span.kind=server system=grpc2046gitlab # [ 264.711811] gitaly[924]: time="2026-08-11T10:51:07.401Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR753PWCNCK3QGMQEH9WKEK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:51:37.200" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:07.401" grpc.time_ms=0.759 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2047gitlab # [ 264.712973] gitaly[924]: time="2026-08-11T10:51:07.403Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1164 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR753M615RJEQ5H96NMPJ52 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:07.329" grpc.time_ms=14.794 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc2048gitlab # [ 264.714042] gitlab-workhorse[824]: time="2026-08-11T10:51:07Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162049gitlab # [ 264.715373] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:07 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 1332050gitlab # [ 264.763505] gitaly[924]: time="2026-08-11T10:51:07.453Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:51:07.452" grpc.time_ms=0.374 pid=924 span.kind=server system=grpc2051gitlab # [ 264.774582] gitaly[924]: time="2026-08-11T10:51:07.465Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H diskcache=ae6731db-320b-4ab4-8c91-efc9acae5b3d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:51:37.166" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:07.267" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2052gitlab # [ 264.775360] gitaly[924]: time="2026-08-11T10:51:07.466Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=113 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7083 command.oublock=0 command.real_time_ms=190 command.spawn_token_fork_ms=1 command.system_time_ms=83 command.user_time_ms=30 component=gitaly.UnaryServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:51:37.166" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:07.267" grpc.time_ms=198.512 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2053gitlab # [ 264.817100] gitaly[924]: time="2026-08-11T10:51:07.508Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=64 command.spawn_token_fork_ms=8 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR753PWCNCK3QGMQEH9WKEK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:51:17.142" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:07.442" grpc.time_ms=65.408 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2054gitlab # [ 264.826071] gitaly[924]: time="2026-08-11T10:51:07.517Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:51:37.416" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:07.516" grpc.time_ms=0.909 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055gitlab # [ 264.845634] gitaly[924]: time="2026-08-11T10:51:07.536Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR753TXSHHEDHWWNDKGBN4Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:51:37.535" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:07.535" grpc.time_ms=1.04 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2056gitlab # [ 264.860866] gitaly[924]: time="2026-08-11T10:51:07.552Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR753TXSHHEDHWWNDKGBN4Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-11T10:51:37.545" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:07.545" grpc.time_ms=6.197 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2057gitlab # [ 264.872805] gitaly[924]: time="2026-08-11T10:51:07.563Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR753TXSHHEDHWWNDKGBN4Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:51:17.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:07.558" grpc.time_ms=5.588 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2058gitlab # [ 264.888490] gitaly[924]: time="2026-08-11T10:51:07.579Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR753TXSHHEDHWWNDKGBN4Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T10:51:17.028" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:51:07.579" grpc.time_ms=0.228 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2059gitlab # [ 264.899340] gitaly[924]: time="2026-08-11T10:51:07.590Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR753TXSHHEDHWWNDKGBN4Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T10:51:17.033" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:07.584" grpc.time_ms=6.03 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2060gitlab # [ 264.931586] gitaly[924]: time="2026-08-11T10:51:07.622Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR753TXSHHEDHWWNDKGBN4Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:51:07.622" grpc.time_ms=0.484 pid=924 span.kind=server system=grpc2061gitlab # [ 264.967629] gitaly[924]: time="2026-08-11T10:51:07.657Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR753TXSHHEDHWWNDKGBN4Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:51:07.657" grpc.time_ms=0.29 pid=924 span.kind=server system=grpc2062gitlab # [ 264.983516] gitaly[924]: time="2026-08-11T10:51:07.673Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR753TXSHHEDHWWNDKGBN4Y diskcache=79d74165-5d94-4fb7-b189-096b61da4277 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:51:17.041" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:51:07.591" pid=924 ref=refs/keep-around/98f31e4960537ad16620ea48b0289a504b33e5c6 remote_ip="2001:db8:1::1" revision=98f31e4960537ad16620ea48b0289a504b33e5c6 span.kind=server system=grpc username=root2063gitlab # [ 264.984947] gitaly[924]: time="2026-08-11T10:51:07.674Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=60 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5342 command.oublock=8 command.real_time_ms=74 command.spawn_token_fork_ms=1 command.system_time_ms=44 command.user_time_ms=16 component=gitaly.UnaryServerInterceptor correlation_id=01KZR753TXSHHEDHWWNDKGBN4Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:51:17.041" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:51:07.591" grpc.time_ms=82.021 pid=924 ref=refs/keep-around/98f31e4960537ad16620ea48b0289a504b33e5c6 remote_ip="2001:db8:1::1" revision=98f31e4960537ad16620ea48b0289a504b33e5c6 span.kind=server system=grpc username=root2064gitlab # [ 264.987603] gitaly[924]: time="2026-08-11T10:51:07.675Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:51:37.574" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:07.674" grpc.time_ms=0.753 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2065gitlab # [ 264.990136] gitaly[924]: time="2026-08-11T10:51:07.679Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR753TXSHHEDHWWNDKGBN4Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:51:37.678" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:07.678" grpc.time_ms=0.389 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2066gitlab # [ 265.099589] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:07.789Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f5b9754fbdc34c2e31f79675","created_at":"2026-08-11T10:51:07.787Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"0858e5882d4002d46e197c15","job_size_bytes":3,"pid":2640,"job_status":"deduplicated","message":"PipelineProcessWorker JID-f5b9754fbdc34c2e31f79675: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2067gitlab # [ 265.101085] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:07.790Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0858e5882d4002d46e197c15","created_at":"2026-08-11T10:51:07.175Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-6a25c627a15f44da","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.183Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2640,"job_status":"rescheduled","message":"PipelineProcessWorker JID-0858e5882d4002d46e197c15: rescheduled"}2068gitlab # [ 265.107529] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:07.798Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0858e5882d4002d46e197c15","created_at":"2026-08-11T10:51:07.175Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-6a25c627a15f44da","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.183Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0858e5882d4002d46e197c15: done: 0.613286 sec","job_status":"done","queue_duration_s":0.001981,"scheduling_latency_s":0.002017,"gitaly_calls":3,"gitaly_duration_s":0.209867,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.017399,"redis_read_bytes":226,"redis_write_bytes":18466,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000842,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000981,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003305,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12312,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.006513,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000466,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000741,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003709,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.177,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":18,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.152,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.196907,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.469485927,"duration_s":0.613286,"completed_at":"2026-08-11T10:51:07.798Z","load_balancing_strategy":"primary","db_duration_s":0.179315,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2069gitlab # [ 265.199116] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:07.800Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"db543a7b94e477a2d46d671c","created_at":"2026-08-11T10:51:07.244Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.246Z","job_size_bytes":23,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-db543a7b94e477a2d46d671c: start","job_status":"start","queue_duration_s":0.553331,"scheduling_latency_s":0.55336}2070gitlab # [ 265.199728] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:07.841Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"db543a7b94e477a2d46d671c","created_at":"2026-08-11T10:51:07.244Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.246Z","job_size_bytes":23,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-db543a7b94e477a2d46d671c: done: 0.041406 sec","job_status":"done","queue_duration_s":0.553331,"scheduling_latency_s":0.55336,"redis_calls":7,"redis_duration_s":0.001789,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001175,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000614,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041406,"completed_at":"2026-08-11T10:51:07.841Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009899,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2071gitlab # [ 265.301566] nix-daemon[2893]: accepted connection from pid 3438, user nixbot2072gitlab # [ 265.302402] nix-daemon[2893]: accepted connection from pid 3446, user nixbot2073gitlab # [ 265.303552] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3492074gitlab # [ 265.304400] nixbot[2679]: {"ts": "2026-08-11T10:51:07.836Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/98f31e4960537ad16620ea48b0289a504b33e5c6 \"HTTP/1.1 201 Created\""}2075gitlab # [ 265.305192] nixbot[2679]: {"ts": "2026-08-11T10:51:07.842Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-98f31e496053-3"}2076gitlab # [ 265.306041] nixbot[2679]: {"ts": "2026-08-11T10:51:07.960Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-98f31e496053-3", "argv0": "bwrap"}2077gitlab # [ 265.306911] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:07.843Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"76ebc21902443c674f4ae66a","created_at":"2026-08-11T10:51:07.471Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.474Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-76ebc21902443c674f4ae66a: start","job_status":"start","queue_duration_s":0.36885,"scheduling_latency_s":0.368872}2078gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6'2079gitlab # [ 265.308059] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:07.868Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"76ebc21902443c674f4ae66a","created_at":"2026-08-11T10:51:07.471Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.474Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-76ebc21902443c674f4ae66a: done: 0.025223 sec","job_status":"done","queue_duration_s":0.36885,"scheduling_latency_s":0.368872,"redis_calls":7,"redis_duration_s":0.0018419999999999999,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001346,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000496,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025223,"completed_at":"2026-08-11T10:51:07.868Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003293,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2080gitlab # [ 265.375764] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:07.869Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"02dce2a89571cc92eb45985f","created_at":"2026-08-11T10:51:07.482Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.484Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-02dce2a89571cc92eb45985f: start","job_status":"start","queue_duration_s":0.385116,"scheduling_latency_s":0.385138}2081gitlab # [ 265.442765] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:07.894Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"02dce2a89571cc92eb45985f","created_at":"2026-08-11T10:51:07.482Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.484Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-02dce2a89571cc92eb45985f: done: 0.02507 sec","job_status":"done","queue_duration_s":0.385116,"scheduling_latency_s":0.385138,"redis_calls":7,"redis_duration_s":0.001689,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001252,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02507,"completed_at":"2026-08-11T10:51:07.894Z","load_balancing_strategy":"primary","db_duration_s":0.003604,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2082gitlab # [ 265.446968] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:07.896Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"eea52a4a8d26a9fef8c5d12c","created_at":"2026-08-11T10:51:07.491Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.493Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-eea52a4a8d26a9fef8c5d12c: start","job_status":"start","queue_duration_s":0.403273,"scheduling_latency_s":0.4033}2083gitlab # [ 265.470329] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:07.928Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"eea52a4a8d26a9fef8c5d12c","created_at":"2026-08-11T10:51:07.491Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.493Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-eea52a4a8d26a9fef8c5d12c: done: 0.03165 sec","job_status":"done","queue_duration_s":0.403273,"scheduling_latency_s":0.4033,"redis_calls":10,"redis_duration_s":0.002398,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001223,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000703,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000472,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03165,"completed_at":"2026-08-11T10:51:07.927Z","load_balancing_strategy":"primary","db_duration_s":0.008434,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2084gitlab # [ 265.534310] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:07.929Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"54327aea49a3b9457b49c975","created_at":"2026-08-11T10:51:07.493Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.495Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-54327aea49a3b9457b49c975: start","job_status":"start","queue_duration_s":0.434288,"scheduling_latency_s":0.434309}2085gitlab # [ 265.603288] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:07.950Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"54327aea49a3b9457b49c975","created_at":"2026-08-11T10:51:07.493Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.495Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-54327aea49a3b9457b49c975: done: 0.020966 sec","job_status":"done","queue_duration_s":0.434288,"scheduling_latency_s":0.434309,"redis_calls":7,"redis_duration_s":0.001705,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001273,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000432,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020966,"completed_at":"2026-08-11T10:51:07.950Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003029,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2086gitlab # [ 265.625457] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:07.951Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"81fc049b807083b00b764493","created_at":"2026-08-11T10:51:07.495Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.497Z","job_size_bytes":19,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-81fc049b807083b00b764493: start","job_status":"start","queue_duration_s":0.454303,"scheduling_latency_s":0.454324}2087gitlab # [ 265.705749] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.079Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"81fc049b807083b00b764493","created_at":"2026-08-11T10:51:07.495Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.497Z","job_size_bytes":19,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-81fc049b807083b00b764493: done: 0.127855 sec","job_status":"done","queue_duration_s":0.454303,"scheduling_latency_s":0.454324,"redis_calls":8,"redis_duration_s":0.002134,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001659,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000475,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.108,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.107,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.127855,"completed_at":"2026-08-11T10:51:08.079Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.107887,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2088gitlab # [ 265.775604] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.081Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a79de1de8076ab63e874f31f","created_at":"2026-08-11T10:51:07.498Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.499Z","job_size_bytes":66,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a79de1de8076ab63e874f31f: start","job_status":"start","queue_duration_s":0.581382,"scheduling_latency_s":0.581409}2089gitlab # [ 265.776731] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.101Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a79de1de8076ab63e874f31f","created_at":"2026-08-11T10:51:07.498Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.499Z","job_size_bytes":66,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a79de1de8076ab63e874f31f: done: 0.020074 sec","job_status":"done","queue_duration_s":0.581382,"scheduling_latency_s":0.581409,"redis_calls":7,"redis_duration_s":0.001761,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001248,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000513,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020074,"completed_at":"2026-08-11T10:51:08.101Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002319,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2090gitlab # [ 265.844524] gitaly[924]: time="2026-08-11T10:51:08.362Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:51:08.361" grpc.time_ms=0.552 pid=924 span.kind=server system=grpc2091gitlab # [ 265.845865] gitaly[924]: time="2026-08-11T10:51:08.386Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:51:08.386" grpc.time_ms=0.48 pid=924 span.kind=server system=grpc2092gitlab # [ 265.847037] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.102Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a8e1ba288b1a1c1c8ac39145","created_at":"2026-08-11T10:51:07.500Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.501Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a8e1ba288b1a1c1c8ac39145: start","job_status":"start","queue_duration_s":0.601106,"scheduling_latency_s":0.601127}2093gitlab # [ 265.926361] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.125Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a8e1ba288b1a1c1c8ac39145","created_at":"2026-08-11T10:51:07.500Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.501Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a8e1ba288b1a1c1c8ac39145: done: 0.02254 sec","job_status":"done","queue_duration_s":0.601106,"scheduling_latency_s":0.601127,"redis_calls":7,"redis_duration_s":0.001789,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001386,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000403,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02254,"completed_at":"2026-08-11T10:51:08.125Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2094gitlab # [ 265.929142] gitaly[924]: time="2026-08-11T10:51:08.410Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:51:08.410" grpc.time_ms=0.409 pid=924 span.kind=server system=grpc2095gitlab # [ 265.996140] gitaly[924]: time="2026-08-11T10:51:08.415Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:51:38.237" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:08.338" operations="[repack_refs]" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096gitlab # [ 265.997208] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.126Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b790d7a18e0317d3c4b3b1d0","created_at":"2026-08-11T10:51:07.502Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.503Z","job_size_bytes":6,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b790d7a18e0317d3c4b3b1d0: start","job_status":"start","queue_duration_s":0.623205,"scheduling_latency_s":0.623225}2097gitlab # [ 265.997963] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.151Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b790d7a18e0317d3c4b3b1d0","created_at":"2026-08-11T10:51:07.502Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.503Z","job_size_bytes":6,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b790d7a18e0317d3c4b3b1d0: done: 0.024889 sec","job_status":"done","queue_duration_s":0.623205,"scheduling_latency_s":0.623225,"redis_calls":7,"redis_duration_s":0.00345,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001905,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001545,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024889,"completed_at":"2026-08-11T10:51:08.151Z","load_balancing_strategy":"primary","db_duration_s":0.003426,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2098gitlab # [ 266.070158] gitaly[924]: time="2026-08-11T10:51:08.417Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:51:38.237" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:08.338" pid=924 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-11 10:50:03.71058568 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2099gitlab # [ 266.071245] gitaly[924]: time="2026-08-11T10:51:08.421Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H diskcache=d8315889-45aa-4c2a-b999-8dfb61f4e9a1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:51:38.237" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:08.338" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2100gitlab # [ 266.141857] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.154Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"11d480f418ef1939947f4f73","created_at":"2026-08-11T10:51:07.503Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.505Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-11d480f418ef1939947f4f73: start","job_status":"start","queue_duration_s":0.649624,"scheduling_latency_s":0.649646}2101gitlab # [ 266.142947] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.187Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"11d480f418ef1939947f4f73","created_at":"2026-08-11T10:51:07.503Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.505Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-11d480f418ef1939947f4f73: done: 0.032744 sec","job_status":"done","queue_duration_s":0.649624,"scheduling_latency_s":0.649646,"redis_calls":7,"redis_duration_s":0.008741,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007707,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032744,"completed_at":"2026-08-11T10:51:08.187Z","load_balancing_strategy":"primary","db_duration_s":0.008294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2102gitlab # [ 266.215876] gitaly[924]: time="2026-08-11T10:51:08.422Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=88 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7733 command.oublock=0 command.real_time_ms=78 command.spawn_token_fork_ms=0 command.system_time_ms=56 command.user_time_ms=32 component=gitaly.UnaryServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:51:38.237" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:08.338" grpc.time_ms=84.029 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2103gitlab # [ 266.217161] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.192Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"07efbb340992bce43dbf87e2","created_at":"2026-08-11T10:51:07.681Z","trace_propagation_headers":{"sentry-trace":"b9c47b4ddd5d4942a17b4e07cf424387-85c8dabd5b334994","baggage":"sentry-trace_id=b9c47b4ddd5d4942a17b4e07cf424387,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR753TXSHHEDHWWNDKGBN4Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.683Z","job_size_bytes":65,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-07efbb340992bce43dbf87e2: start","job_status":"start","queue_duration_s":0.50915,"scheduling_latency_s":0.509172}2104gitlab # [ 266.218219] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.229Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"07efbb340992bce43dbf87e2","created_at":"2026-08-11T10:51:07.681Z","trace_propagation_headers":{"sentry-trace":"b9c47b4ddd5d4942a17b4e07cf424387-85c8dabd5b334994","baggage":"sentry-trace_id=b9c47b4ddd5d4942a17b4e07cf424387,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR753TXSHHEDHWWNDKGBN4Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.683Z","job_size_bytes":65,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-07efbb340992bce43dbf87e2: done: 0.036732 sec","job_status":"done","queue_duration_s":0.50915,"scheduling_latency_s":0.509172,"redis_calls":7,"redis_duration_s":0.006865,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003398,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003467,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036732,"completed_at":"2026-08-11T10:51:08.229Z","load_balancing_strategy":"primary","db_duration_s":0.007174,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2105gitlab # [ 266.293181] gitaly[924]: time="2026-08-11T10:51:08.436Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:51:38.237" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:08.338" pid=924 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2106gitlab # [ 266.363216] gitaly[924]: time="2026-08-11T10:51:08.436Z" level=info msg="optimized repository" clean_stale_data_time=18.233603ms clean_work_trees_time="136.33µs" commit_graph_time="7.822µs" correlation_id=01KZR75398ZV8F50XZ1SZX5F7H gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="8.101µs" pid=924 prune_time="7.822µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="8.381µs" storage_name=default system=housekeeping total_time=18.600968ms2107gitlab # [ 266.364901] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.231Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"32edff81c90233841119338e","created_at":"2026-08-11T10:51:07.684Z","trace_propagation_headers":{"sentry-trace":"b9c47b4ddd5d4942a17b4e07cf424387-85c8dabd5b334994","baggage":"sentry-trace_id=b9c47b4ddd5d4942a17b4e07cf424387,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR753TXSHHEDHWWNDKGBN4Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.685Z","job_size_bytes":65,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-32edff81c90233841119338e: start","job_status":"start","queue_duration_s":0.545375,"scheduling_latency_s":0.545403}2108gitlab # [ 266.366138] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.274Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"32edff81c90233841119338e","created_at":"2026-08-11T10:51:07.684Z","trace_propagation_headers":{"sentry-trace":"b9c47b4ddd5d4942a17b4e07cf424387-85c8dabd5b334994","baggage":"sentry-trace_id=b9c47b4ddd5d4942a17b4e07cf424387,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR753TXSHHEDHWWNDKGBN4Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.685Z","job_size_bytes":65,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-32edff81c90233841119338e: done: 0.043514 sec","job_status":"done","queue_duration_s":0.545375,"scheduling_latency_s":0.545403,"redis_calls":10,"redis_duration_s":0.002606,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001167,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001439,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043514,"completed_at":"2026-08-11T10:51:08.274Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009598,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2109gitlab # [ 266.440239] gitaly[924]: time="2026-08-11T10:51:08.436Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:51:38.237" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:08.338" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2110gitlab # [ 266.441750] gitaly[924]: time="2026-08-11T10:51:08.488Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=18 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=18 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:51:38.368" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:08.469" grpc.time_ms=19.548 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111gitlab # [ 266.442895] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.276Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"141139c6ded6e35a6bffd85a","created_at":"2026-08-11T10:51:07.791Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.792Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-141139c6ded6e35a6bffd85a: start","job_status":"start","queue_duration_s":0.483059,"scheduling_latency_s":0.483081}2112gitlab # [ 266.517193] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.524Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"141139c6ded6e35a6bffd85a","created_at":"2026-08-11T10:51:07.791Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f6560a107a944a8f","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.792Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-141139c6ded6e35a6bffd85a: done: 0.248306 sec","job_status":"done","queue_duration_s":0.483059,"scheduling_latency_s":0.483081,"gitaly_calls":3,"gitaly_duration_s":0.112489,"redis_calls":63,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.012681,"redis_read_bytes":142,"redis_write_bytes":16722,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000665,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00109,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":20,"redis_queues_duration_s":0.002805,"redis_queues_read_bytes":22,"redis_queues_write_bytes":11228,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.004285,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000268,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000996,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001907,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099369,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.220079088,"duration_s":0.248306,"completed_at":"2026-08-11T10:51:08.524Z","load_balancing_strategy":"primary","db_duration_s":0.028334,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2113gitlab # [ 266.586479] gitaly[924]: time="2026-08-11T10:51:08.513Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR75398ZV8F50XZ1SZX5F7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:51:38.412" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:08.513" grpc.time_ms=0.578 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 266.587967] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.525Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"4c92e664704307a2e4dde56e","created_at":"2026-08-11T10:51:07.816Z","trace_propagation_headers":{"sentry-trace":"b9c47b4ddd5d4942a17b4e07cf424387-85c8dabd5b334994","baggage":"sentry-trace_id=b9c47b4ddd5d4942a17b4e07cf424387,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR753TXSHHEDHWWNDKGBN4Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.819Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4c92e664704307a2e4dde56e: start","job_status":"start","queue_duration_s":0.706185,"scheduling_latency_s":0.706207}2115gitlab # [ 266.589070] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.630Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"4c92e664704307a2e4dde56e","created_at":"2026-08-11T10:51:07.816Z","trace_propagation_headers":{"sentry-trace":"b9c47b4ddd5d4942a17b4e07cf424387-85c8dabd5b334994","baggage":"sentry-trace_id=b9c47b4ddd5d4942a17b4e07cf424387,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR753TXSHHEDHWWNDKGBN4Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:07.819Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4c92e664704307a2e4dde56e: done: 0.104869 sec","job_status":"done","queue_duration_s":0.706185,"scheduling_latency_s":0.706207,"gitaly_calls":2,"gitaly_duration_s":0.006183,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008379000000000001,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000938,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000971,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000273,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001561,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000222,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000541,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002935,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070213,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.070281559,"duration_s":0.104869,"completed_at":"2026-08-11T10:51:08.630Z","load_balancing_strategy":"primary","db_duration_s":0.02438,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2116gitlab # [ 266.667489] gitaly[924]: time="2026-08-11T10:51:08.591Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR753TXSHHEDHWWNDKGBN4Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:51:38.490" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:08.591" grpc.time_ms=0.717 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2117gitlab # [ 266.735258] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.632Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d854b87c16b5013c6b6ed088","created_at":"2026-08-11T10:51:08.330Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.332Z","job_size_bytes":23,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d854b87c16b5013c6b6ed088: start","job_status":"start","queue_duration_s":0.299615,"scheduling_latency_s":0.299638}2118gitlab # [ 266.736737] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.667Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d854b87c16b5013c6b6ed088","created_at":"2026-08-11T10:51:08.330Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.332Z","job_size_bytes":23,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d854b87c16b5013c6b6ed088: done: 0.034743 sec","job_status":"done","queue_duration_s":0.299615,"scheduling_latency_s":0.299638,"redis_calls":7,"redis_duration_s":0.001551,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000425,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034743,"completed_at":"2026-08-11T10:51:08.667Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006015,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2119gitlab # [ 266.807287] gitaly[924]: time="2026-08-11T10:51:08.617Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR753TXSHHEDHWWNDKGBN4Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:51:38.516" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:08.617" grpc.time_ms=0.641 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2120gitlab # [ 266.808795] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.668Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4feba073f26660985ebf2beb","created_at":"2026-08-11T10:51:08.430Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.432Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4feba073f26660985ebf2beb: start","job_status":"start","queue_duration_s":0.235966,"scheduling_latency_s":0.235988}2121gitlab # [ 266.810380] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.694Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4feba073f26660985ebf2beb","created_at":"2026-08-11T10:51:08.430Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.432Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4feba073f26660985ebf2beb: done: 0.026316 sec","job_status":"done","queue_duration_s":0.235966,"scheduling_latency_s":0.235988,"redis_calls":7,"redis_duration_s":0.0018399999999999998,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001419,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000421,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026316,"completed_at":"2026-08-11T10:51:08.694Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003543,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2122gitlab # [ 266.880234] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.696Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"b828f6719693c49596ca176c","created_at":"2026-08-11T10:51:08.439Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.440Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-b828f6719693c49596ca176c: start","job_status":"start","queue_duration_s":0.255732,"scheduling_latency_s":0.255754}2123gitlab # [ 266.947303] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.719Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"b828f6719693c49596ca176c","created_at":"2026-08-11T10:51:08.439Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.440Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-b828f6719693c49596ca176c: done: 0.023412 sec","job_status":"done","queue_duration_s":0.255732,"scheduling_latency_s":0.255754,"redis_calls":7,"redis_duration_s":0.00149,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001084,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023412,"completed_at":"2026-08-11T10:51:08.719Z","load_balancing_strategy":"primary","db_duration_s":0.004011,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2124gitlab # [ 267.015288] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.721Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"430dd425df69570ccd346a0e","created_at":"2026-08-11T10:51:08.447Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.449Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-430dd425df69570ccd346a0e: start","job_status":"start","queue_duration_s":0.272013,"scheduling_latency_s":0.272035}2125gitlab # [ 267.016429] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.746Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"430dd425df69570ccd346a0e","created_at":"2026-08-11T10:51:08.447Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.449Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-430dd425df69570ccd346a0e: done: 0.025074 sec","job_status":"done","queue_duration_s":0.272013,"scheduling_latency_s":0.272035,"redis_calls":10,"redis_duration_s":0.002124,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000589,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000401,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025074,"completed_at":"2026-08-11T10:51:08.746Z","load_balancing_strategy":"primary","db_duration_s":0.003616,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2126gitlab # [ 267.091374] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.747Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a7a0193fe2c250c191396e60","created_at":"2026-08-11T10:51:08.449Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.451Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a7a0193fe2c250c191396e60: start","job_status":"start","queue_duration_s":0.29678,"scheduling_latency_s":0.296801}2127gitlab # [ 267.092889] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.768Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a7a0193fe2c250c191396e60","created_at":"2026-08-11T10:51:08.449Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.451Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a7a0193fe2c250c191396e60: done: 0.020502 sec","job_status":"done","queue_duration_s":0.29678,"scheduling_latency_s":0.296801,"redis_calls":7,"redis_duration_s":0.001576,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001173,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000403,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013563,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020502,"completed_at":"2026-08-11T10:51:08.768Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2128gitlab # [ 267.159661] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.769Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c48467cd7fd3731da03d876a","created_at":"2026-08-11T10:51:08.451Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.453Z","job_size_bytes":19,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c48467cd7fd3731da03d876a: start","job_status":"start","queue_duration_s":0.31634,"scheduling_latency_s":0.316363}2129gitlab # [ 267.228220] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.789Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c48467cd7fd3731da03d876a","created_at":"2026-08-11T10:51:08.451Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.453Z","job_size_bytes":19,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c48467cd7fd3731da03d876a: done: 0.019686 sec","job_status":"done","queue_duration_s":0.31634,"scheduling_latency_s":0.316363,"redis_calls":8,"redis_duration_s":0.0017569999999999999,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001354,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000403,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019686,"completed_at":"2026-08-11T10:51:08.789Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2130gitlab # [ 267.297299] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.790Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a514ff3ddb6b845daae1574e","created_at":"2026-08-11T10:51:08.454Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.455Z","job_size_bytes":66,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a514ff3ddb6b845daae1574e: start","job_status":"start","queue_duration_s":0.335105,"scheduling_latency_s":0.335127}2131gitlab # [ 267.298406] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.809Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a514ff3ddb6b845daae1574e","created_at":"2026-08-11T10:51:08.454Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.455Z","job_size_bytes":66,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a514ff3ddb6b845daae1574e: done: 0.018513 sec","job_status":"done","queue_duration_s":0.335105,"scheduling_latency_s":0.335127,"redis_calls":7,"redis_duration_s":0.001533,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001118,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000415,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018513,"completed_at":"2026-08-11T10:51:08.809Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002109,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2132gitlab # [ 267.387307] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.810Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"9e9a1921863b45f1ebf8d575","created_at":"2026-08-11T10:51:08.456Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.457Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9e9a1921863b45f1ebf8d575: start","job_status":"start","queue_duration_s":0.353439,"scheduling_latency_s":0.35346}2133gitlab # [ 267.388808] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.831Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"9e9a1921863b45f1ebf8d575","created_at":"2026-08-11T10:51:08.456Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.457Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9e9a1921863b45f1ebf8d575: done: 0.021254 sec","job_status":"done","queue_duration_s":0.353439,"scheduling_latency_s":0.35346,"redis_calls":7,"redis_duration_s":0.001452,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001053,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000399,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021254,"completed_at":"2026-08-11T10:51:08.831Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2134gitlab # [ 267.457884] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.833Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"a05e2f58c1cb906868755cf0","created_at":"2026-08-11T10:51:08.457Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.459Z","job_size_bytes":6,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-a05e2f58c1cb906868755cf0: start","job_status":"start","queue_duration_s":0.374033,"scheduling_latency_s":0.374053}2135gitlab # [ 267.459123] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.845Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"a05e2f58c1cb906868755cf0","created_at":"2026-08-11T10:51:08.457Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.459Z","job_size_bytes":6,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-a05e2f58c1cb906868755cf0: done: 0.012587 sec","job_status":"done","queue_duration_s":0.374033,"scheduling_latency_s":0.374053,"redis_calls":7,"redis_duration_s":0.0014730000000000001,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001033,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012587,"completed_at":"2026-08-11T10:51:08.845Z","load_balancing_strategy":"primary","db_duration_s":0.000375,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2136gitlab # [ 267.527219] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.847Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3061a186546cccd79b9ecb3c","created_at":"2026-08-11T10:51:08.459Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.460Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3061a186546cccd79b9ecb3c: start","job_status":"start","queue_duration_s":0.386372,"scheduling_latency_s":0.386392}2137gitlab # [ 267.528407] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.866Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3061a186546cccd79b9ecb3c","created_at":"2026-08-11T10:51:08.459Z","trace_propagation_headers":{"sentry-trace":"5aca1b7368a94340b69a9c7f414ea7a5-f396ed1058484e36","baggage":"sentry-trace_id=5aca1b7368a94340b69a9c7f414ea7a5,sentry-release=Unknown"},"correlation_id":"01KZR75398ZV8F50XZ1SZX5F7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.460Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3061a186546cccd79b9ecb3c: done: 0.018949 sec","job_status":"done","queue_duration_s":0.386372,"scheduling_latency_s":0.386392,"redis_calls":7,"redis_duration_s":0.001478,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001083,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000395,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018949,"completed_at":"2026-08-11T10:51:08.866Z","load_balancing_strategy":"primary","db_duration_s":0.002614,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2138gitlab # [ 267.599320] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.867Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"75373b35f64e8682a46e70e3","created_at":"2026-08-11T10:51:08.578Z","trace_propagation_headers":{"sentry-trace":"b9c47b4ddd5d4942a17b4e07cf424387-cf4f8f229e4d46a0","baggage":"sentry-trace_id=b9c47b4ddd5d4942a17b4e07cf424387,sentry-release=Unknown"},"correlation_id":"01KZR753TXSHHEDHWWNDKGBN4Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.580Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-75373b35f64e8682a46e70e3: start","job_status":"start","queue_duration_s":0.287397,"scheduling_latency_s":0.287417}2139gitlab # [ 267.668131] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:08.893Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"75373b35f64e8682a46e70e3","created_at":"2026-08-11T10:51:08.578Z","trace_propagation_headers":{"sentry-trace":"b9c47b4ddd5d4942a17b4e07cf424387-cf4f8f229e4d46a0","baggage":"sentry-trace_id=b9c47b4ddd5d4942a17b4e07cf424387,sentry-release=Unknown"},"correlation_id":"01KZR753TXSHHEDHWWNDKGBN4Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:08.580Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-75373b35f64e8682a46e70e3: done: 0.025663 sec","job_status":"done","queue_duration_s":0.287397,"scheduling_latency_s":0.287417,"redis_calls":7,"redis_duration_s":0.001542,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001104,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000438,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025663,"completed_at":"2026-08-11T10:51:08.893Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2140gitlab # [ 267.765321] nixbot[2679]: INFO: ::ffff:127.0.0.1:41472 - "GET /api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 200 OK2141gitlab # [ 267.768941] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/602517e9867335656a7404cbf404a70e499058fa HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 30992142gitlab # [ 267.774866] nixbot[2679]: {"ts": "2026-08-11T10:51:10.466Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/602517e9867335656a7404cbf404a70e499058fa \"HTTP/1.1 201 Created\""}2143gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=98f31e4960537ad16620ea48b0289a504b33e5c6', in 2.39 seconds)2144(finished: subtest: push delivers the webhook, in 61.24 seconds)2145subtest: eval and build post commit statuses2146gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/98f31e4960537ad16620ea48b0289a504b33e5c6/statuses2147gitlab # [ 267.810812] nix-daemon[2893]: accepted connection from pid 3490, user nixbot2148gitlab # [ 267.830327] gitaly[924]: time="2026-08-11T10:51:10.521Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR756R9MM11E8B0ADHMZBA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:10.513" grpc.time_ms=7.251 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc2149gitlab # [ 267.850740] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 482150gitlab # [ 267.855096] nix-daemon[2893]: accepted connection from pid 3508, user nixbot2151gitlab # [ 267.866921] nix-daemon[2893]: accepted connection from pid 3490, user nixbot2152gitlab # [ 267.888635] gitaly[924]: time="2026-08-11T10:51:10.579Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR756SV79GWTMSJ6GXDCYSM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:10.570" pid=924 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2153gitlab # [ 267.904578] gitaly[924]: time="2026-08-11T10:51:10.579Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR756SV79GWTMSJ6GXDCYSM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:10.570" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc2154gitlab # [ 267.925218] gitlab-workhorse[824]: time="2026-08-11T10:51:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672155gitlab # [ 267.928319] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 562156gitlab # [ 267.931651] gitaly[924]: time="2026-08-11T10:51:10.579Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR756SV79GWTMSJ6GXDCYSM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:10.570" grpc.time_ms=9.185 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc2157gitlab # [ 267.953915] gitaly[924]: time="2026-08-11T10:51:10.591Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR756T2N3XSDE7YKMM8AB28 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:51:40.589" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:10.589" grpc.time_ms=0.586 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2158gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/98f31e4960537ad16620ea48b0289a504b33e5c6/statuses, in 0.17 seconds)2159gitlab # [ 267.973951] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/98f31e4960537ad16620ea48b0289a504b33e5c6/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 932160gitlab # [ 267.982897] nix-daemon[2893]: accepted connection from pid 3531, user nixbot2161gitlab # [ 268.016334] gitaly[924]: time="2026-08-11T10:51:10.707Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR756Y50TBQFSM59F3QXXZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:51:40.006" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:10.706" grpc.time_ms=0.584 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2162gitlab # [ 268.050562] gitaly[924]: time="2026-08-11T10:51:10.741Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR756Y50TBQFSM59F3QXXZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:51:20.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:10.735" grpc.time_ms=6.497 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2163gitlab # [ 268.081276] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:10.772Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"dabebadc427b97450e46b5e6","created_at":"2026-08-11T10:51:10.765Z","trace_propagation_headers":{"sentry-trace":"444e9c18a22a4ebda2d11443c4adc643-906b2a478d314d5c","baggage":"sentry-trace_id=444e9c18a22a4ebda2d11443c4adc643,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR756Y50TBQFSM59F3QXXZ1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:10.770Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-dabebadc427b97450e46b5e6: start","job_status":"start","queue_duration_s":0.001901,"scheduling_latency_s":0.001943}2164gitlab # [ 268.092037] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1212165gitlab # [ 268.092897] nixbot[2679]: {"ts": "2026-08-11T10:51:10.784Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/98f31e4960537ad16620ea48b0289a504b33e5c6 \"HTTP/1.1 201 Created\""}2166gitlab # [ 268.144355] gitaly[924]: time="2026-08-11T10:51:10.835Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR757230F402A7T5SD111DR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:51:40.833" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:10.834" grpc.time_ms=0.893 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2167gitlab # [ 268.180511] gitaly[924]: time="2026-08-11T10:51:10.871Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR757230F402A7T5SD111DR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:51:20.244" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:10.865" grpc.time_ms=6.556 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2168gitlab # [ 268.221589] gitaly[924]: time="2026-08-11T10:51:10.912Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR756Y50TBQFSM59F3QXXZ1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:51:10.912" grpc.time_ms=0.316 pid=924 span.kind=server system=grpc2169gitlab # [ 268.248805] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1522170gitlab # [ 268.250169] nixbot[2679]: {"ts": "2026-08-11T10:51:10.941Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/98f31e4960537ad16620ea48b0289a504b33e5c6 \"HTTP/1.1 201 Created\""}2171gitlab # [ 268.266880] gitaly[924]: time="2026-08-11T10:51:10.958Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR756Y50TBQFSM59F3QXXZ1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:51:10.957" grpc.time_ms=0.571 pid=924 span.kind=server system=grpc2172gitlab # [ 268.303385] gitaly[924]: time="2026-08-11T10:51:10.994Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR756Y50TBQFSM59F3QXXZ1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:51:10.994" grpc.time_ms=0.424 pid=924 span.kind=server system=grpc2173gitlab # [ 268.307253] gitaly[924]: time="2026-08-11T10:51:10.998Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR75779QHF6Z92A819ZH3K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:51:40.296" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:10.997" grpc.time_ms=1.246 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2174gitlab # [ 268.336411] gitaly[924]: time="2026-08-11T10:51:11.027Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR75779QHF6Z92A819ZH3K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:51:21.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:11.021" grpc.time_ms=6.147 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2175gitlab # [ 268.366446] gitaly[924]: time="2026-08-11T10:51:11.057Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR756Y50TBQFSM59F3QXXZ1 diskcache=3342adad-0954-4861-9814-a9ba2bd05c47 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:51:40.785" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:10.885" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2176gitlab # [ 268.367836] gitaly[924]: time="2026-08-11T10:51:11.057Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=80 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7059 command.oublock=0 command.real_time_ms=165 command.spawn_token_fork_ms=0 command.system_time_ms=48 command.user_time_ms=32 component=gitaly.UnaryServerInterceptor correlation_id=01KZR756Y50TBQFSM59F3QXXZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:51:40.785" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:51:10.885" grpc.time_ms=171.845 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 268.381580] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/98f31e4960537ad16620ea48b0289a504b33e5c6 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1182178gitlab # [ 268.382470] nixbot[2679]: {"ts": "2026-08-11T10:51:11.073Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/98f31e4960537ad16620ea48b0289a504b33e5c6 \"HTTP/1.1 201 Created\""}2179gitlab # [ 268.420197] gitaly[924]: time="2026-08-11T10:51:11.111Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR756Y50TBQFSM59F3QXXZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:51:41.010" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:11.110" grpc.time_ms=0.801 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2180gitlab # [ 268.444838] gitaly[924]: time="2026-08-11T10:51:11.136Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR756Y50TBQFSM59F3QXXZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:51:41.034" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:51:11.135" grpc.time_ms=0.828 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2181gitlab # [ 268.452675] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:11.143Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"504d8c1dc7e454aa84811c7b","created_at":"2026-08-11T10:51:11.141Z","trace_propagation_headers":{"sentry-trace":"444e9c18a22a4ebda2d11443c4adc643-59f0ae33ce904349","baggage":"sentry-trace_id=444e9c18a22a4ebda2d11443c4adc643,sentry-release=Unknown"},"correlation_id":"01KZR756Y50TBQFSM59F3QXXZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"dabebadc427b97450e46b5e6","job_size_bytes":3,"pid":2640,"job_status":"deduplicated","message":"PipelineProcessWorker JID-504d8c1dc7e454aa84811c7b: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2182gitlab # [ 268.453809] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:11.145Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"dabebadc427b97450e46b5e6","created_at":"2026-08-11T10:51:10.765Z","trace_propagation_headers":{"sentry-trace":"444e9c18a22a4ebda2d11443c4adc643-906b2a478d314d5c","baggage":"sentry-trace_id=444e9c18a22a4ebda2d11443c4adc643,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR756Y50TBQFSM59F3QXXZ1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:10.770Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2640,"job_status":"rescheduled","message":"PipelineProcessWorker JID-dabebadc427b97450e46b5e6: rescheduled"}2183gitlab # [ 268.459407] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:11.150Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"dabebadc427b97450e46b5e6","created_at":"2026-08-11T10:51:10.765Z","trace_propagation_headers":{"sentry-trace":"444e9c18a22a4ebda2d11443c4adc643-906b2a478d314d5c","baggage":"sentry-trace_id=444e9c18a22a4ebda2d11443c4adc643,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR756Y50TBQFSM59F3QXXZ1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:10.770Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-dabebadc427b97450e46b5e6: done: 0.378423 sec","job_status":"done","queue_duration_s":0.001901,"scheduling_latency_s":0.001943,"gitaly_calls":3,"gitaly_duration_s":0.179988,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.017289,"redis_read_bytes":239,"redis_write_bytes":21783,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001002,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001215,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.004313,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14468,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.00702,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00028,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000628,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001829,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.116364,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.303943657,"duration_s":0.378423,"completed_at":"2026-08-11T10:51:11.150Z","load_balancing_strategy":"primary","db_duration_s":0.034085,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2184gitlab # [ 268.527903] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:11.151Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"ae9cb23e7916a5d96781ded5","created_at":"2026-08-11T10:51:10.879Z","trace_propagation_headers":{"sentry-trace":"444e9c18a22a4ebda2d11443c4adc643-59f0ae33ce904349","baggage":"sentry-trace_id=444e9c18a22a4ebda2d11443c4adc643,sentry-release=Unknown"},"correlation_id":"01KZR756Y50TBQFSM59F3QXXZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:10.881Z","job_size_bytes":23,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-ae9cb23e7916a5d96781ded5: start","job_status":"start","queue_duration_s":0.270726,"scheduling_latency_s":0.270757}2185gitlab # [ 268.609172] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:11.203Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"ae9cb23e7916a5d96781ded5","created_at":"2026-08-11T10:51:10.879Z","trace_propagation_headers":{"sentry-trace":"444e9c18a22a4ebda2d11443c4adc643-59f0ae33ce904349","baggage":"sentry-trace_id=444e9c18a22a4ebda2d11443c4adc643,sentry-release=Unknown"},"correlation_id":"01KZR756Y50TBQFSM59F3QXXZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:10.881Z","job_size_bytes":23,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-ae9cb23e7916a5d96781ded5: done: 0.051893 sec","job_status":"done","queue_duration_s":0.270726,"scheduling_latency_s":0.270757,"redis_calls":7,"redis_duration_s":0.001799,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001253,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000546,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051893,"completed_at":"2026-08-11T10:51:11.203Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023988,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2186gitlab # [ 268.610778] nix-daemon[2893]: accepted connection from pid 3579, user nixbot2187gitlab # [ 268.611858] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:11.205Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4122451da31024218baee465","created_at":"2026-08-11T10:51:11.062Z","trace_propagation_headers":{"sentry-trace":"444e9c18a22a4ebda2d11443c4adc643-59f0ae33ce904349","baggage":"sentry-trace_id=444e9c18a22a4ebda2d11443c4adc643,sentry-release=Unknown"},"correlation_id":"01KZR756Y50TBQFSM59F3QXXZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:11.064Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4122451da31024218baee465: start","job_status":"start","queue_duration_s":0.140263,"scheduling_latency_s":0.140287}2188gitlab # [ 268.693057] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:11.230Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4122451da31024218baee465","created_at":"2026-08-11T10:51:11.062Z","trace_propagation_headers":{"sentry-trace":"444e9c18a22a4ebda2d11443c4adc643-59f0ae33ce904349","baggage":"sentry-trace_id=444e9c18a22a4ebda2d11443c4adc643,sentry-release=Unknown"},"correlation_id":"01KZR756Y50TBQFSM59F3QXXZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:11.064Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4122451da31024218baee465: done: 0.025545 sec","job_status":"done","queue_duration_s":0.140263,"scheduling_latency_s":0.140287,"redis_calls":7,"redis_duration_s":0.00172,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00125,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00047,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025545,"completed_at":"2026-08-11T10:51:11.230Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006522,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2189gitlab # [ 268.764373] gitaly[924]: time="2026-08-11T10:51:11.417Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=7 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR757KTRMB06PWXXE170DSP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:11.403" grpc.time_ms=13.274 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc2190gitlab # [ 268.766106] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 632191gitlab # [ 268.766896] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:11.232Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"4d9cdfe7c68d722ceaf72299","created_at":"2026-08-11T10:51:11.071Z","trace_propagation_headers":{"sentry-trace":"444e9c18a22a4ebda2d11443c4adc643-59f0ae33ce904349","baggage":"sentry-trace_id=444e9c18a22a4ebda2d11443c4adc643,sentry-release=Unknown"},"correlation_id":"01KZR756Y50TBQFSM59F3QXXZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:11.074Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-4d9cdfe7c68d722ceaf72299: start","job_status":"start","queue_duration_s":0.157753,"scheduling_latency_s":0.157775}2192gitlab # [ 268.767689] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:11.254Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"4d9cdfe7c68d722ceaf72299","created_at":"2026-08-11T10:51:11.071Z","trace_propagation_headers":{"sentry-trace":"444e9c18a22a4ebda2d11443c4adc643-59f0ae33ce904349","baggage":"sentry-trace_id=444e9c18a22a4ebda2d11443c4adc643,sentry-release=Unknown"},"correlation_id":"01KZR756Y50TBQFSM59F3QXXZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:11.074Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-4d9cdfe7c68d722ceaf72299: done: 0.021713 sec","job_status":"done","queue_duration_s":0.157753,"scheduling_latency_s":0.157775,"redis_calls":7,"redis_duration_s":0.00162,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001197,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000423,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021713,"completed_at":"2026-08-11T10:51:11.254Z","load_balancing_strategy":"primary","db_duration_s":0.003579,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2193gitlab # [ 268.882608] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:11.255Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"bff86ca280b4cc3840598cc5","created_at":"2026-08-11T10:51:11.081Z","trace_propagation_headers":{"sentry-trace":"444e9c18a22a4ebda2d11443c4adc643-59f0ae33ce904349","baggage":"sentry-trace_id=444e9c18a22a4ebda2d11443c4adc643,sentry-release=Unknown"},"correlation_id":"01KZR756Y50TBQFSM59F3QXXZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:11.083Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-bff86ca280b4cc3840598cc5: start","job_status":"start","queue_duration_s":0.172515,"scheduling_latency_s":0.172536}2194gitlab # [ 268.883881] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:11.281Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"bff86ca280b4cc3840598cc5","created_at":"2026-08-11T10:51:11.081Z","trace_propagation_headers":{"sentry-trace":"444e9c18a22a4ebda2d11443c4adc643-59f0ae33ce904349","baggage":"sentry-trace_id=444e9c18a22a4ebda2d11443c4adc643,sentry-release=Unknown"},"correlation_id":"01KZR756Y50TBQFSM59F3QXXZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:11.083Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-bff86ca280b4cc3840598cc5: done: 0.0255 sec","job_status":"done","queue_duration_s":0.172515,"scheduling_latency_s":0.172536,"redis_calls":10,"redis_duration_s":0.0023239999999999997,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001187,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000623,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0255,"completed_at":"2026-08-11T10:51:11.281Z","load_balancing_strategy":"primary","db_duration_s":0.00432,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2195gitlab # [ 268.955831] nix-daemon[2893]: accepted connection from pid 3611, user nixbot2196gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/98f31e4960537ad16620ea48b0289a504b33e5c6/statuses2197gitlab # [ 268.957500] gitaly[924]: time="2026-08-11T10:51:11.495Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR757NV1126R6HV7JRSHSZC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:51:11.485" pid=924 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2198gitlab # [ 268.958637] gitlab-workhorse[824]: time="2026-08-11T10:51:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672199gitlab # [ 268.959678] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/11:10:51:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 772200gitlab # [ 268.960846] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:11.282Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"682240f78bfc84143982b515","created_at":"2026-08-11T10:51:11.083Z","trace_propagation_headers":{"sentry-trace":"444e9c18a22a4ebda2d11443c4adc643-59f0ae33ce904349","baggage":"sentry-trace_id=444e9c18a22a4ebda2d11443c4adc643,sentry-release=Unknown"},"correlation_id":"01KZR756Y50TBQFSM59F3QXXZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:11.085Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-682240f78bfc84143982b515: start","job_status":"start","queue_duration_s":0.197454,"scheduling_latency_s":0.197475}2201gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/98f31e4960537ad16620ea48b0289a504b33e5c6/statuses, in 0.10 seconds)2202(finished: subtest: eval and build post commit statuses, in 1.27 seconds)2203(finished: run the VM test script, in 306.47 seconds)2204gitlab # [ 268.961938] sidekiq-cluster[2640]: {"severity":"INFO","time":"2026-08-11T10:51:11.303Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"682240f78bfc84143982b515","created_at":"2026-08-11T10:51:11.083Z","trace_propagation_headers":{"sentry-trace":"444e9c18a22a4ebda2d11443c4adc643-59f0ae33ce904349","baggage":"sentry-trace_id=444e9c18a22a4ebda2d11443c4adc643,sentry-release=Unknown"},"correlation_id":"01KZR756Y50TBQFSM59F3QXXZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-11T10:51:11.085Z","job_size_bytes":3,"pid":2640,"sidekiq_tid":"m81k","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-682240f78bfc84143982b515: done: 0.020776 sec","job_status":"done","queue_duration_s":0.197454,"scheduling_latency_s":0.197475,"redis_calls":7,"redis_duration_s":0.001578,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001152,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000426,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020776,"completed_at":"2026-08-11T10:51:11.303Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003303,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2205test script finished in 306.49s2206cleanup2207kill QemuMachine (pid 46)2208gitlab # [ 269.030428] gitaly[924]: time="2026-08-11T10:51:11.495Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR757NV1126R6HV7JRSHSZC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.Smaqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2209(finished: cleanup, in 0.02 seconds)2210additionally exposed symbols:2211 gitlab,2212 vlan1,2213 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2214[]2215[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-11T10:50:08.905Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2216[]2217[]2218[]2219[]2220[]2221[]2222[]2223[]2224[]2225[]2226[]2227[]2228[]2229[]2230[]2231[]2232[]2233[]2234[]2235[]2236[]2237[]2238[]2239[]2240[]2241[]2242[]2243[]2244[]2245[]2246[]2247[]2248[]2249[]2250[]2251[]2252[]2253[]2254[]2255[]2256[]2257[]2258[]2259[]2260[]2261[]2262[]2263[]2264[]2265[]2266[]2267[]2268[]2269[]2270[]2271[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '98f31e4960537ad16620ea48b0289a504b33e5c6', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-11T10:51:07.476177Z', 'started_at': '2026-08-11T10:51:07.838080Z', 'finished_at': None}]2272[{'id': 5, 'sha': '98f31e4960537ad16620ea48b0289a504b33e5c6', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T10:51:07.789Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2273[{'id': 5, 'sha': '98f31e4960537ad16620ea48b0289a504b33e5c6', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-11T10:51:07.789Z', 'started_at': None, 'finished_at': '2026-08-11T10:51:10.759Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '98f31e4960537ad16620ea48b0289a504b33e5c6', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-11T10:51:10.916Z', 'started_at': None, 'finished_at': '2026-08-11T10:51:11.044Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]