vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #490
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.CDgmKWj4x5', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: a0ad6f8b-1237-4a8b-ae84-bbeb90e65e0616gitlab # Superblock backups stored on blocks:17gitlab # 32768, 98304, 163840, 22937618gitlab # 19(finished: start all VMs, in 54.93 seconds)20gitlab # Allocating group tables: 0/8 done21gitlab: waiting for unit setup-gitlab.service22gitlab # Writing inode tables: 0/8 done23gitlab: waiting for the VM to finish booting24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/j4vmybf3jbsdy10022dii7r3a4z4506g-nixos-system-gitlab-test/init regInfo=/nix/store/9ppfvfjh3mzb9nfcsd12qncrai8g9kkw-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 532049438 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.010 MHz processor67gitlab # [ 0.000810] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000876] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002732] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002743] Using GB pages for direct mapping73gitlab # [ 0.002904] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002911] ACPI: Early table checksum verification disabled75gitlab # [ 0.002914] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002917] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002921] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002928] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002930] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002931] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002933] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002935] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002936] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002937] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002938] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002938] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002938] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002939] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003156] No NUMA configuration found90gitlab # [ 0.003157] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003159] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005458] Zone ranges:93gitlab # [ 0.005458] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005460] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005461] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005462] Device empty97gitlab # [ 0.005463] Movable zone start for each node98gitlab # [ 0.005463] Early memory node ranges99gitlab # [ 0.005464] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005465] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005466] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005467] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005486] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005752] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.114499] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.114924] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.114938] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.114976] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.114979] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.114981] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.114982] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.114983] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.114984] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.114986] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.114987] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.114992] TSC deadline timer available117gitlab # [ 0.114996] CPU topo: Max. logical packages: 1118gitlab # [ 0.114997] CPU topo: Max. logical dies: 1119gitlab # [ 0.114997] CPU topo: Max. dies per package: 1120gitlab # [ 0.115001] CPU topo: Max. threads per core: 1121gitlab # [ 0.115001] CPU topo: Num. cores per package: 4122gitlab # [ 0.115002] CPU topo: Num. threads per package: 4123gitlab # [ 0.115002] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.115026] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.115042] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.115044] kvm-guest: setup PV sched yield127gitlab # [ 0.115060] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.115061] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.115062] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.115064] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.115065] Booting paravirtualized kernel on KVM132gitlab # [ 0.115069] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.119534] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.121778] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.121833] kvm-guest: PV spinlocks enabled136gitlab # [ 0.121835] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.121838] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/j4vmybf3jbsdy10022dii7r3a4z4506g-nixos-system-gitlab-test/init regInfo=/nix/store/9ppfvfjh3mzb9nfcsd12qncrai8g9kkw-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.121932] Unknown kernel command line parameters "regInfo=/nix/store/9ppfvfjh3mzb9nfcsd12qncrai8g9kkw-closure-info/registration", will be passed to user space.139gitlab # [ 0.121945] random: crng init done140gitlab # [ 0.121946] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.130912] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.135592] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.135667] software IO TLB: area num 4.144gitlab # [ 0.210570] Fallback order for Node 0: 0145gitlab # [ 0.210577] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.210579] Policy zone: Normal147gitlab # [ 0.213090] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.222631] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.236584] allocated 12582912 bytes of page_ext150gitlab # [ 0.246487] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.246489] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.247313] Dynamic Preempt: lazy153gitlab # [ 0.247538] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.247539] rcu: RCU event tracing is enabled.155gitlab # [ 0.247539] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.247541] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.247541] Rude variant of Tasks RCU enabled.158gitlab # [ 0.247541] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.247542] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.247543] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.247568] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.247570] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.247571] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.251932] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.252239] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.252248] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.252356] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.255966] Console: colour VGA+ 80x25169gitlab # [ 0.255969] printk: legacy console [tty0] enabled170gitlab # [ 0.287036] printk: legacy console [ttyS0] enabled171gitlab # [ 0.398242] ACPI: Core revision 20250807172gitlab # [ 0.399207] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.400842] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.401913] x2apic enabled175gitlab # [ 0.402677] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.403644] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.404935] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.406449] kvm-guest: setup PV IPIs179gitlab # [ 0.408033] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.409122] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns181gitlab # [ 0.410963] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400010)182gitlab # [ 0.412048] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.413995] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.415960] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.416965] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.418961] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.419961] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.421787] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.422960] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.423961] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.424968] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.426563] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.427961] active return thunk: srso_alias_return_thunk194gitlab # [ 0.428982] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.429960] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.430960] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.431961] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.433821] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.434960] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.435961] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.436961] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.437961] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.438960] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.439960] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.441786] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.442787] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.472507] Freeing SMP alternatives memory: 44K208gitlab # [ 0.472963] pid_max: default: 32768 minimum: 301209gitlab # [ 0.474087] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.475053] landlock: Up and running.211gitlab # [ 0.475961] Yama: becoming mindful.212gitlab # [ 0.477145] LSM support for eBPF active213gitlab # [ 0.478060] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.479109] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.481046] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.482563] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.482970] ... version: 2218gitlab # [ 0.483761] ... bit width: 48219gitlab # [ 0.483963] ... generic counters: 6220gitlab # [ 0.484721] ... generic bitmap: 000000000000003f221gitlab # [ 0.484963] ... fixed-purpose counters: 0222gitlab # [ 0.485756] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.486736] ... value mask: 0000ffffffffffff224gitlab # [ 0.486963] ... max period: 00007fffffffffff225gitlab # [ 0.487933] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.488865] signal: max sigframe size: 3376227gitlab # [ 0.489647] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.489967] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.491086] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.496490] smp: Bringing up secondary CPUs ...231gitlab # [ 0.497370] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.497966] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.501107] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.502692] smpboot: Total of 4 processors activated (19200.08 BogoMIPS)235gitlab # [ 0.503476] Memory: 6011604K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved)236gitlab # [ 0.504963] devtmpfs: initialized237gitlab # [ 0.505764] x86/mm: Memory block size: 128MB238gitlab # [ 0.509154] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.510096] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.511070] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.512223] PM: RTC time: 12:08:54, date: 2026-11-07242gitlab # [ 0.515934] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.518166] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.519019] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.521071] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.521975] audit: initializing netlink subsys (disabled)247gitlab # [ 0.523021] audit: type=2000 audit(1794053334.887:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.523277] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.524964] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.525963] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.526963] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.527963] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.528977] cpuidle: using governor menu254gitlab # [ 0.531189] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.532255] PCI: Using configuration type 1 for base access256gitlab # [ 0.532964] PCI: Using configuration type 1 for extended access257gitlab # [ 0.534152] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.537297] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.537964] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.538963] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.539963] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.545027] ACPI: Added _OSI(Module Device)263gitlab # [ 0.546974] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.548969] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.555903] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.563481] ACPI: Interpreter enabled267gitlab # [ 0.565006] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.566970] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.569004] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.571971] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.575313] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.588341] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.590981] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.595795] acpiphp: Slot [3] registered275gitlab # [ 0.597008] acpiphp: Slot [4] registered276gitlab # [ 0.599007] acpiphp: Slot [5] registered277gitlab # [ 0.600028] acpiphp: Slot [6] registered278gitlab # [ 0.601008] acpiphp: Slot [7] registered279gitlab # [ 0.603007] acpiphp: Slot [8] registered280gitlab # [ 0.604026] acpiphp: Slot [9] registered281gitlab # [ 0.606030] acpiphp: Slot [10] registered282gitlab # [ 0.607006] acpiphp: Slot [11] registered283gitlab # [ 0.608006] acpiphp: Slot [12] registered284gitlab # [ 0.610024] acpiphp: Slot [13] registered285gitlab # [ 0.611005] acpiphp: Slot [14] registered286gitlab # [ 0.613017] acpiphp: Slot [15] registered287gitlab # [ 0.614005] acpiphp: Slot [16] registered288gitlab # [ 0.614902] acpiphp: Slot [17] registered289gitlab # [ 0.615571] acpiphp: Slot [18] registered290gitlab # [ 0.616983] acpiphp: Slot [19] registered291gitlab # [ 0.617728] acpiphp: Slot [20] registered292gitlab # [ 0.617991] acpiphp: Slot [21] registered293gitlab # [ 0.618756] acpiphp: Slot [22] registered294gitlab # [ 0.619984] acpiphp: Slot [23] registered295gitlab # [ 0.620727] acpiphp: Slot [24] registered296gitlab # [ 0.620983] acpiphp: Slot [25] registered297gitlab # [ 0.621747] acpiphp: Slot [26] registered298gitlab # [ 0.622982] acpiphp: Slot [27] registered299gitlab # [ 0.623737] acpiphp: Slot [28] registered300gitlab # [ 0.623991] acpiphp: Slot [29] registered301gitlab # [ 0.625409] acpiphp: Slot [30] registered302gitlab # [ 0.627029] acpiphp: Slot [31] registered303gitlab # [ 0.629104] PCI host bridge to bus 0000:00304gitlab # [ 0.631000] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.633970] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.635969] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.638970] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.641981] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.645994] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.648768] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.653284] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.658065] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.664046] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.666052] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.667967] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.669967] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.671967] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.674334] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.680041] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.684110] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.685230] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.686985] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.688362] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.711100] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.712994] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.715010] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.717586] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.722428] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.731166] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.731970] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.732984] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.745971] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.748452] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.753049] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.754998] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.758026] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.765273] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.775986] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.777984] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.781023] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.787047] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.795987] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.798984] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.802022] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.808365] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.816991] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.818980] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.821010] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.825028] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.830999] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.831943] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.832799] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.836201] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.839997] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.840937] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.841799] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.842969] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.846205] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.848483] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.849987] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.852221] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.857005] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.857938] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.858796] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.861228] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.864996] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.866970] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.867984] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.872649] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.874123] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.875115] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.876107] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.878051] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.881034] iommu: Default domain type: Translated375gitlab # [ 0.881654] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.883228] ACPI: bus type USB registered377gitlab # [ 0.884053] usbcore: registered new interface driver usbfs378gitlab # [ 0.884980] usbcore: registered new interface driver hub379gitlab # [ 0.885906] usbcore: registered new device driver usb380gitlab # [ 0.888258] NetLabel: Initializing381gitlab # [ 0.888966] NetLabel: domain hash size = 128382gitlab # [ 0.889727] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.891054] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.891974] PCI: Using ACPI for IRQ routing385gitlab # [ 0.893074] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.893959] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.893959] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.895968] vgaarb: loaded389gitlab # [ 0.896784] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.897662] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.903301] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.906318] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.907066] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.908925] pnp: PnP ACPI init395gitlab # [ 0.910121] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.919092] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.922825] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.925596] NET: Registered PF_INET protocol family399gitlab # [ 0.930695] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.965841] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.967453] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.968866] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.972816] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.974199] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.975690] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.977392] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.978904] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.980316] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.981348] NET: Registered PF_XDP protocol family410gitlab # [ 0.982255] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.983360] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.984443] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.985626] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.986829] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.988255] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.989308] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.991785] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.994557] PCI: CLS 0 bytes, default 64419gitlab # [ 0.995410] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.995696] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.996530] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.996669] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns423gitlab # [ 1.020324] Initialise system trusted keyrings424gitlab # [ 1.021566] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.033376] Key type asymmetric registered426gitlab # [ 1.034153] Asymmetric key parser 'x509' registered427gitlab # [ 1.035108] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.036959] io scheduler mq-deadline registered429gitlab # [ 1.037771] io scheduler kyber registered430gitlab # [ 1.041318] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.042749] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.045269] Linux agpgart interface v0.103433gitlab # [ 1.046076] ACPI: bus type drm_connector registered434gitlab # [ 1.048465] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.049618] usbserial: USB Serial support registered for generic436gitlab # [ 1.050684] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.050684] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.053105] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.054554] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.055836] NET: Registered PF_INET6 protocol family441gitlab # [ 1.057744] Segment Routing with IPv6442gitlab # [ 1.058457] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.061304] IPI shorthand broadcast: enabled444gitlab # [ 1.065732] sched_clock: Marking stable (915010988, 150711952)->(1088516251, -22793311)445gitlab # [ 1.067640] registered taskstats version 1446gitlab # [ 1.068752] Loading compiled-in X.509 certificates447gitlab # [ 1.078439] Demotion targets for Node 0: null448gitlab # [ 1.079567] Key type .fscrypt registered449gitlab # [ 1.080349] Key type fscrypt-provisioning registered450gitlab # [ 1.081358] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.082345] ima: Allocated hash algorithm: sha1452gitlab # [ 1.083199] ima: No architecture policies found453gitlab # [ 1.084334] PM: Magic number: 2:892:126454gitlab # [ 1.085134] acpi device:01: hash matches455gitlab # [ 1.086749] RAS: Correctable Errors collector initialized.456gitlab # [ 1.091297] clk: Disabling unused clocks457gitlab # [ 1.092031] PM: genpd: Disabling unused power domains458gitlab # [ 1.274516] Freeing initrd memory: 29392K459gitlab # [ 1.282235] Freeing unused decrypted memory: 2028K460gitlab # [ 1.288534] Freeing unused kernel image (initmem) memory: 3640K461gitlab # [ 1.291249] Write protecting the kernel read-only data: 32768k462gitlab # [ 1.296131] Freeing unused kernel image (text/rodata gap) memory: 1220K463gitlab # [ 1.299968] Freeing unused kernel image (rodata/data gap) memory: 760K464gitlab # [ 1.368394] x86/mm: Checked W+X mappings: passed, no W+X pages found.465gitlab # [ 1.369595] Run /init as init process466gitlab # [ 1.382566] systemd[1]: Inserted module 'autofs4'467gitlab # [ 1.404992] fuse: init (API version 7.45)468gitlab # [ 1.413744] ACPI: \_SB_.LNKC: Enabled at IRQ 10469gitlab # [ 1.420018] ACPI: \_SB_.LNKA: Enabled at IRQ 10470gitlab # [ 1.423076] ACPI: \_SB_.LNKB: Enabled at IRQ 11471gitlab # [ 1.457354] systemd[1]: Successfully made /usr/ read-only.472gitlab # [ 1.794147] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)473gitlab # [ 1.834690] systemd[1]: Detected virtualization kvm.474gitlab # [ 1.836925] systemd[1]: Detected architecture x86-64.475gitlab # [ 1.839157] systemd[1]: Running in initrd.476gitlab # [ 1.841588] systemd[1]: Initializing machine ID from random generator.477gitlab # [ 1.844546] systemd[1]: Hostname set to <gitlab>.478gitlab # [ 1.954830] systemd[1]: bpf-restrict-fs: LSM BPF program attached479gitlab # [ 2.021844] systemd[1]: Queued start job for default target Initrd Default Target.480gitlab # [ 2.031555] systemd[1]: Created slice Slice /system/modprobe.481gitlab # [ 2.032786] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.482gitlab # [ 2.034222] systemd[1]: Expecting device /dev/disk/by-label/nix-store...483gitlab # [ 2.035428] systemd[1]: Expecting device /dev/disk/by-label/nixos...484gitlab # [ 2.036578] systemd[1]: Reached target Path Units.485gitlab # [ 2.037475] systemd[1]: Reached target Slice Units.486gitlab # [ 2.038394] systemd[1]: Reached target Swaps.487gitlab # [ 2.039234] systemd[1]: Reached target Timer Units.488gitlab # [ 2.040254] systemd[1]: Listening on D-Bus System Message Bus Socket.489gitlab # [ 2.041511] systemd[1]: Listening on Journal Socket (/dev/log).490gitlab # [ 2.042760] systemd[1]: Listening on Journal Sockets.491gitlab # [ 2.043831] systemd[1]: Listening on udev Control Socket.492gitlab # [ 2.044896] systemd[1]: Listening on udev Kernel Socket.493gitlab # [ 2.045889] systemd[1]: Reached target Socket Units.494gitlab # [ 2.047926] systemd[1]: Starting Create List of Static Device Nodes...495gitlab # [ 2.050012] systemd[1]: Starting Load Kernel Module 9pnet_virtio...496gitlab # [ 2.051993] systemd[1]: Starting Load Kernel Module configfs...497gitlab # [ 2.063800] systemd[1]: Starting Journal Service...498gitlab # [ 2.066804] systemd[1]: Starting Load Kernel Modules...499gitlab # [ 2.067877] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os500gitlab # [ 2.073864] systemd[1]: Starting Coldplug All udev Devices...501gitlab # [ 2.083767] systemd-journald[93]: Collecting audit messages is disabled.502gitlab # [ 2.087846] systemd[1]: Finished Create List of Static Device Nodes.503gitlab # [ 2.092020] systemd[1]: modprobe@configfs.service: Deactivated successfully.504gitlab # [ 2.094078] systemd[1]: Finished Load Kernel Module configfs.505gitlab # [ 2.097097] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config506gitlab # [ 2.100883] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...507gitlab # [ 2.103056] netfs: FS-Cache loaded508gitlab # [ 2.110841] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.509gitlab # [ 2.114667] 9pnet: Installing 9P2000 support510gitlab # [ 2.120206] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev511gitlab # [ 2.121952] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.512gitlab # [ 2.124011] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.513gitlab # [ 2.125829] systemd[1]: Finished Load Kernel Module 9pnet_virtio.514gitlab # [ 2.127538] systemd[1]: Finished Load Kernel Modules.515gitlab # [ 1.978560] systemd-modules-load[94]: Using 4 probe threads516gitlab # [ 2.129820] systemd[1]: Starting Apply Kernel Variables...517gitlab # [ 1.980305] systemd-modules-load[94]: Inserted module 'virtio_balloon'518gitlab # [ 1.981467] systemd-modules-load[94]: Inserted module 'virtio[ 2.132374] systemd[1]: Starting Create Static Device Nodes in /dev...519gitlab # _gpu'520gitlab # [ 1.983224] systemd-modules-l[ 2.133776] systemd[1]: Started Journal Service.521gitlab # oad[94]: Inserted module 'dm_mod'522gitlab # [ 1.991782] systemd[1]: Finished Apply Kernel Variables.523gitlab # [ 1.992677] systemd[1]: Finished Create Static Device Nodes in /dev.524gitlab # [ 1.993596] systemd[1]: Reached target Preparation for Local File Systems.525gitlab # [ 1.994731] systemd[1]: Reached target Local File Systems.526gitlab # [ 1.995641] systemd[1]: Starting Create System Files and Directories...527gitlab # [ 1.996621] systemd[1]: Starting Rule-based Manager for Device Events and Files...528gitlab # [ 2.008077] systemd[1]: Finished Create System Files and Directories.529gitlab # [ 2.017153] systemd-udevd[113]: Using default interface naming scheme 'v261'.530gitlab # [ 2.027184] systemd[1]: Started Rule-based Manager for Device Events and Files.531gitlab # [ 2.069235] systemd[1]: Finished Coldplug All udev Devices.532gitlab # [ 2.070387] systemd[1]: Reached target System Initialization.533gitlab # [ 2.071593] systemd[1]: Reached target Basic System.534gitlab # [ 2.299944] uhci_hcd 0000:00:01.2: UHCI Host Controller535gitlab # [ 2.300776] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1536gitlab # [ 2.301900] uhci_hcd 0000:00:01.2: detected 2 ports537gitlab # [ 2.302755] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140538gitlab # [ 2.303827] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18539gitlab # [ 2.305071] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1540gitlab # [ 2.306230] usb usb1: Product: UHCI Host Controller541gitlab # [ 2.306311] SCSI subsystem initialized542gitlab # [ 2.306451] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd543gitlab # [ 2.309624] usb usb1: SerialNumber: 0000:00:01.2544gitlab # [ 2.311475] hub 1-0:1.0: USB hub found545gitlab # [ 2.312148] hub 1-0:1.0: 2 ports detected546gitlab # [ 2.319916] virtio_blk virtio4: 4/0/0 default/read/poll queues547gitlab # [ 2.322451] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)548gitlab # [ 2.333343] virtio_blk virtio5: 4/0/0 default/read/poll queues549gitlab # [ 2.336094] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12550gitlab # [ 2.337991] scsi host0: ata_piix551gitlab # [ 2.338047] serio: i8042 KBD port at 0x60,0x64 irq 1552gitlab # [ 2.339262] serio: i8042 AUX port at 0x60,0x64 irq 12553gitlab # [ 2.341757] scsi host1: ata_piix554gitlab # [ 2.342539] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0555gitlab # [ 2.343767] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0556gitlab # [ 2.344977] virtio_blk virtio5: [vdb] 11953368 512-byte logical blocks (6.12 GB/5.70 GiB)557gitlab # [ 2.219845] systemd[1]: Starting Virtual Console Setup...558gitlab # [ 2.243680] systemd-vconsole-setup[151]: Configuration of first virtual console was skipped, ignoring remaining ones.559gitlab # [ 2.245308] systemd[1]: Finished Virtual Console Setup.560gitlab # [ 2.508036] ata2: found unknown device (class 0)561gitlab # [ 2.510705] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100562gitlab # [ 2.514764] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5563gitlab # [ 2.532800] usb 1-1: new full-speed USB device number 2 using uhci_hcd564gitlab # [ 2.406606] (udev-worker)[117]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.565gitlab # [ 2.411791] (udev-worker)[117]: Network interface NamePolicy= disabled on kernel command line.566gitlab # [ 2.415636] (udev-worker)[125]: Network interface NamePolicy= disabled on kernel command line[ 2.567812] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0567gitlab # .568gitlab # [ 2.439117] systemd[1]: Found device /dev/disk/by-label/nixos.569gitlab # [ 2.444667] systemd[1]: Found device /dev/disk/by-label/nix-store.570gitlab # [ 2.446593] systemd[1]: Reached target Initrd Root Device.571gitlab # [ 2.448154] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...572gitlab # [ 2.607798] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray573gitlab # [ 2.482859] systemd-fsck[158]: nixos: clean, 12/65536 files, 13019/262144 blocks574gitlab # [ 2.487177] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.575gitlab # [ 2.641279] cdrom: Uniform CD-ROM driver Revision: 3.20576gitlab # [ 2.701881] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00577gitlab # [ 2.704908] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10578gitlab # [ 2.707505] usb 1-1: Product: QEMU USB Tablet579gitlab # [ 2.709245] usb 1-1: Manufacturer: QEMU580gitlab # [ 2.710775] usb 1-1: SerialNumber: 28754-0000:00:01.2-1581gitlab # [ 2.728250] hid: raw HID events driver (C) Jiri Kosina582gitlab # [ 2.735895] usbcore: registered new interface driver usbhid583gitlab # [ 2.736646] usbhid: USB HID core driver584gitlab # [ 2.740485] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2585gitlab # [ 2.742447] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0586gitlab # [ 2.928885] systemd[1]: Mounting /sysroot...587gitlab # [ 3.226415] EXT4-fs (vda): mounted filesystem a0ad6f8b-1237-4a8b-ae84-bbeb90e65e06 r/w with ordered data mode. Quota mode: none.588gitlab # [ 3.081691] systemd[1]: Mounted /sysroot.589gitlab # [ 3.083432] systemd[1]: Reached target Initrd Root File System.590gitlab # [ 3.085500] systemd[1]: Mounting /sysroot/nix/.ro-store...591gitlab # [ 3.088195] systemd[1]: Mounting /sysroot/nix/.rw-store...592gitlab # [ 3.089688] systemd[1]: Mounting /sysroot/run...593gitlab # [ 3.090854] systemd[1]: Mounting /sysroot/tmp/shared...594gitlab # [ 3.102183] systemd[1]: Mounting /sysroot/tmp/xchg...595gitlab # [ 3.108338] systemd[1]: Starting Mountpoints Configured in the Real Root...596gitlab # [ 3.114289] systemd-sysroot-fstab-check[178]: /sysroot should be mounted in the initrd, will request daemon-reload.597gitlab # [ 3.117084] systemd[1]: Mounted /sysroot/nix/.rw-store.598gitlab # [ 3.118327] systemd[1]: Mounted /sysroot/run.599gitlab # [ 3.270699] 9p: Installing v9fs 9p2000 file system support600gitlab # [ 3.121095] systemd[1]: Reload requested from client PID 178 ('systemd-sysroot') (unit initrd-parse-etc.service)...601gitlab # [ 3.124238] systemd[1]: Reloading...602gitlab # [ 3.281437] erofs (device vdb): mounted with root inode @ nid 128.603gitlab # [ 3.181493] systemd[1]: Reloading finished in 58 ms.604gitlab # [ 3.205235] systemd-sysroot-fstab-check[178]: Requesting initrd-fs.target/start/replace...605gitlab # [ 3.207897] systemd[1]: Mounted /sysroot/nix/.ro-store.606gitlab # [ 3.209586] systemd[1]: Mounted /sysroot/tmp/shared.607gitlab # [ 3.211260] systemd[1]: Mounted /sysroot/tmp/xchg.608gitlab # [ 3.212916] systemd[1]: Starting rw-sysroot-nix-store.service...609gitlab # [ 3.214906] systemd-sysroot-fstab-check[178]: Requesting swap.target/start/replace...610gitlab # [ 3.218086] systemd[1]: initrd-parse-etc.service: Deactivated successfully.611gitlab # [ 3.222850] systemd[1]: Finished Mountpoints Configured in the Real Root.612gitlab # [ 3.225139] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.613gitlab # [ 3.228469] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.614gitlab # [ 3.230820] systemd[1]: Finished rw-sysroot-nix-store.service.615gitlab # [ 3.928084] systemd[1]: Mounting /sysroot/nix/store...616gitlab # [ 3.973092] systemd[1]: Mounted /sysroot/nix/store.617gitlab # [ 3.974828] systemd[1]: Reached target Initrd File Systems.618gitlab # [ 3.976699] systemd[1]: Starting Find NixOS closure...619gitlab # [ 3.978482] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...620gitlab # [ 4.010331] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.621gitlab # [ 4.012833] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.622gitlab # [ 4.015099] systemd[1]: Finished Find NixOS closure.623gitlab # [ 4.017561] systemd[1]: Reached target Initrd Default Target.624gitlab # [ 4.020800] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...625gitlab # [ 4.050788] systemd[1]: Stopped target Initrd Default Target.626gitlab # [ 4.052668] systemd[1]: Stopped target Basic System.627gitlab # [ 4.053960] systemd[1]: Stopped target Initrd Root Device.628gitlab # [ 4.055349] systemd[1]: Stopped target Path Units.629gitlab # [ 4.056559] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.630gitlab # [ 4.058530] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.631gitlab # [ 4.060595] systemd[1]: Stopped target Slice Units.632gitlab # [ 4.061865] systemd[1]: Stopped target Socket Units.633gitlab # [ 4.063145] systemd[1]: Stopped target System Initialization.634gitlab # [ 4.064672] systemd[1]: Stopped target Swaps.635gitlab # [ 4.065927] systemd[1]: Stopped target Timer Units.636gitlab # [ 4.067977] systemd[1]: dbus.socket: Deactivated successfully.637gitlab # [ 4.069646] systemd[1]: Closed D-Bus System Message Bus Socket.638gitlab # [ 4.071207] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.639gitlab # [ 4.073573] systemd[1]: Stopped Find NixOS closure.640gitlab # [ 4.075310] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio641gitlab # [ 4.079076] systemd[1]: Starting rw-sysroot-nix-store.service...642gitlab # [ 4.080663] systemd[1]: systemd-sysctl.service: Deactivated successfully.643gitlab # [ 4.083979] systemd[1]: Stopped Apply Kernel Variables.644gitlab # [ 4.085606] systemd[1]: systemd-modules-load.service: Deactivated successfully.645gitlab # [ 4.087470] systemd[1]: Stopped Load Kernel Modules.646gitlab # [ 4.088843] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.647gitlab # [ 4.090866] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.648gitlab # [ 4.092871] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.649gitlab # [ 4.094782] systemd[1]: Stopped Create System Files and Directories.650gitlab # [ 4.096427] systemd[1]: Stopped target Local File Systems.651gitlab # [ 4.097947] systemd[1]: Stopped target Preparation for Local File Systems.652gitlab # [ 4.099245] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.653gitlab # [ 4.100511] systemd[1]: Stopped Coldplug All udev Devices.654gitlab # [ 4.101514] systemd[1]: Stopping Rule-based Manager for Device Events and Files...655gitlab # [ 4.102797] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.656gitlab # [ 4.104056] systemd[1]: Stopped Virtual Console Setup.657gitlab # [ 4.104940] systemd[1]: initrd-cleanup.service: Deactivated successfully.658gitlab # [ 4.105865] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.659gitlab # [ 4.106807] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.660gitlab # [ 4.107860] systemd[1]: Finished rw-sysroot-nix-store.service.661gitlab # [ 4.108800] systemd[1]: systemd-udevd.service: Deactivated successfully.662gitlab # [ 4.109750] systemd[1]: Stopped Rule-based Manager for Device Events and Files.663gitlab # [ 4.110760] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.664gitlab # [ 4.111756] systemd[1]: Closed udev Control Socket.665gitlab # [ 4.112494] systemd[1]: Starting Cleanup udev Database...666gitlab # [ 4.113289] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.667gitlab # [ 4.114291] systemd[1]: Stopped Create Static Device Nodes in /dev.668gitlab # [ 4.115217] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.669gitlab # [ 4.116303] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.670gitlab # [ 4.117319] systemd[1]: kmod-static-nodes.service: Deactivated successfully.671gitlab # [ 4.118273] systemd[1]: Stopped Create List of Static Device Nodes.672gitlab # [ 4.119137] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.673gitlab # [ 4.120187] systemd[1]: Finished Cleanup udev Database.674gitlab # [ 4.120917] systemd[1]: Reached target Switch Root.675gitlab # [ 4.121608] systemd[1]: Starting NixOS Activation...676gitlab # [ 4.210924] initrd-nixos-activation-start[227]: booting system configuration /nix/store/j4vmybf3jbsdy10022dii7r3a4z4506g-nixos-system-gitlab-test677gitlab # [ 4.250506] initrd-nixos-activation-start[227]: running activation script...678gitlab # [ 4.451878] initrd-nixos-activation-start[250]: setting up /etc...679gitlab # [ 4.540002] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.680gitlab # [ 4.541608] systemd[1]: Finished NixOS Activation.681gitlab # [ 4.543689] systemd[1]: Starting Switch Root...682gitlab # [ 4.574336] systemd[1]: Switching root.683gitlab # [ 4.781325] systemd-journald[93]: Received SIGTERM from PID 1 (systemd).684gitlab # [ 4.886323] NET: Registered PF_VSOCK protocol family685gitlab # [ 5.256888] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)686gitlab # [ 5.267397] systemd[1]: Detected virtualization kvm.687gitlab # [ 5.269408] systemd[1]: Detected architecture x86-64.688gitlab # [ 5.271503] systemd[1]: Detected first boot.689gitlab # [ 5.274137] systemd[1]: Initializing machine ID from random generator.690gitlab # [ 5.414086] systemd[1]: bpf-restrict-fs: LSM BPF program attached691gitlab # [ 5.466183] systemd[1]: Applying preset policy.692gitlab # [ 5.580894] systemd[1]: Populated /etc with preset unit settings.693gitlab # [ 5.685411] systemd[1]: initrd-switch-root.service: Deactivated successfully.694gitlab # [ 5.686812] systemd[1]: Stopped initrd-switch-root.service.695gitlab # [ 5.689109] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.696gitlab # [ 5.691364] systemd[1]: Created slice Slice /system/getty.697gitlab # [ 5.692899] systemd[1]: Created slice GitLab DevOps Platform Slice.698gitlab # [ 5.694403] systemd[1]: Created slice User and Session Slice.699gitlab # [ 5.695501] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.700gitlab # [ 5.696810] systemd[1]: Started Forward Password Requests to Wall Directory Watch.701gitlab # [ 5.698092] systemd[1]: Expecting device /dev/hvc0...702gitlab # [ 5.698842] systemd[1]: Expecting device /dev/ttyS0...703gitlab # [ 5.699621] systemd[1]: Reached target Local Encrypted Volumes.704gitlab # [ 5.700529] systemd[1]: Stopped target initrd-fs.target.705gitlab # [ 5.701342] systemd[1]: Stopped target initrd-root-fs.target.706gitlab # [ 5.702207] systemd[1]: Stopped target initrd-switch-root.target.707gitlab # [ 5.703089] systemd[1]: Reached target Virtual Machines and Containers.708gitlab # [ 5.704031] systemd[1]: Reached target Path Units.709gitlab # [ 5.704775] systemd[1]: Reached target Remote File Systems.710gitlab # [ 5.705619] systemd[1]: Reached target Slice Units.711gitlab # [ 5.706368] systemd[1]: Reached target Swaps.712gitlab # [ 5.707789] systemd[1]: Listening on Query the User Interactively for a Password.713gitlab # [ 5.709732] systemd[1]: Listening on Process Core Dump Socket.714gitlab # [ 5.711152] systemd[1]: Listening on Credential Encryption/Decryption.715gitlab # [ 5.712746] systemd[1]: Listening on Factory Reset Management.716gitlab # [ 5.713682] systemd[1]: Listening on Hostname Service Socket.717gitlab # [ 5.715963] systemd[1]: Starting Journal Log Access Socket...718gitlab # [ 5.717209] systemd[1]: Listening on Journal Audit Socket.719gitlab # [ 5.718857] systemd[1]: Listening on Console Output Muting Service Socket.720gitlab # [ 5.719975] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.721gitlab # [ 5.721154] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os722gitlab # [ 5.722485] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki723gitlab # [ 5.725455] systemd[1]: Listening on Disk Repartitioning Service Socket.724gitlab # [ 5.726671] systemd[1]: Listening on udev Control Socket.725gitlab # [ 5.727742] systemd[1]: Listening on udev Varlink Socket.726gitlab # [ 5.730379] systemd[1]: Mounting Huge Pages File System...727gitlab # [ 5.732459] systemd[1]: Mounting POSIX Message Queue File System...728gitlab # [ 5.734502] systemd[1]: Mounting Kernel Debug File System...729gitlab # [ 5.737784] systemd[1]: Mounting Kernel Trace File System...730gitlab # [ 5.744602] systemd[1]: Starting Create List of Static Device Nodes...731gitlab # [ 5.745908] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio732gitlab # [ 5.749793] systemd[1]: Starting Load Kernel Module configfs...733gitlab # [ 5.752543] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm734gitlab # [ 5.754079] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore735gitlab # [ 5.755811] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse736gitlab # [ 5.771782] systemd[1]: Mounting FUSE Control File System...737gitlab # [ 5.772726] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67738gitlab # [ 5.777235] systemd[1]: Starting Journal Service...739gitlab # [ 5.779137] systemd[1]: Starting Load Kernel Modules...740gitlab # [ 5.782165] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...741gitlab # [ 5.788894] systemd[1]: Starting Remount Root and Kernel File Systems...742gitlab # [ 5.791429] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os743gitlab # [ 5.796266] systemd-journald[321]: Collecting audit messages is enabled.744gitlab # [ 5.798865] systemd[1]: Starting Coldplug All udev Devices...745gitlab # [ 5.807555] systemd[1]: Listening on Journal Log Access Socket.746gitlab # [ 5.809577] systemd[1]: Mounted Huge Pages File System.747gitlab # [ 5.811433] systemd[1]: Mounted POSIX Message Queue File System.748gitlab # [ 5.813530] systemd[1]: Mounted Kernel Debug File System.749gitlab # [ 5.815432] systemd[1]: Mounted Kernel Trace File System.750gitlab # [ 5.667387] systemd[1]: Queued start job for default target Multi-User System.[ 5.819204] EXT4-fs (vda): re-mounted a0ad6f8b-1237-4a8b-ae84-bbeb90e65e06.751gitlab # 752gitlab # [ 5.819233] loop: module loaded753gitlab # [ 5.820713] systemd[1]: Finished Create List of Static Device Nodes.754gitlab # [ 5.670493] systemd[1]: Unnecessary job was removed for /dev/vdb.755gitlab # [ 5.822476] systemd[1]: Started Journal Service.756gitlab # [ 5.672246] systemd[1]: systemd-journald.service: Deactivated successfully.757gitlab # [ 5.674099] systemd-modules-load[322]: Using 3 probe threads758gitlab # [ 5.675524] systemd-oomd[323]: No swap; memory pressure usage will be degraded759gitlab # [ 5.677224] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.760gitlab # [ 5.678336] systemd[1]: modprobe@configfs.service: Deactivated successfully.761gitlab # [ 5.679445] systemd[1]: Finished Load Kernel Module configfs.762gitlab # [ 5.680458] systemd[1]: Mounted FUSE Control File System.763gitlab # [ 5.681427] systemd-modules-load[322]: Inserted module 'loop'764gitlab # [ 5.682433] systemd[1]: Finished Remount Root and Kernel File Systems.765gitlab # [ 5.683491] systemd-modules-load[322]: Inserted module 'tls'766gitlab # [ 5.684352] systemd[1]: Finished Load Kernel Modules.767gitlab # [ 5.685100] systemd[1]: Listening on Disk Image Download Service Socket.768gitlab # [ 5.686045] systemd[1]: Mounting Kernel Configuration File System...769gitlab # [ 5.686969] systemd[1]: Starting Firewall...770gitlab # [ 5.687700] systemd[1]: Starting Flush Journal to Persistent Storage...771gitlab # [ 5.688646] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore772gitlab # [ 5.691457] systemd[1]: Starting Load/Save OS Random Seed...773gitlab # [ 5.845363] systemd-journald[321]: Received client request to flush runtime journal.774gitlab # [ 5.743305] systemd[1]: Starting Apply Kernel Variables...775gitlab # [ 5.745530] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...776gitlab # [ 5.746837] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os777gitlab # [ 5.748273] systemd[1]: Mounted Kernel Configuration File System.778gitlab # [ 5.749215] systemd[1]: Finished Load/Save OS Random Seed.779gitlab # [ 5.750091] systemd[1]: Reached target First Boot Complete.780gitlab # [ 5.750949] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.781gitlab # [ 5.752049] systemd[1]: Starting Create Static Device Nodes in /dev...782gitlab # [ 5.753028] systemd[1]: Finished Apply Kernel Variables.783gitlab # [ 5.753798] systemd[1]: Finished Flush Journal to Persistent Storage.784gitlab # [ 5.754680] systemd[1]: Finished Create Static Device Nodes in /dev.785gitlab # [ 5.755613] systemd[1]: Reached target Preparation for Local File Systems.786gitlab # [ 5.756650] systemd[1]: Starting Rule-based Manager for Device Events and Files...787gitlab # [ 5.774273] systemd-udevd[363]: Using default interface naming scheme 'v261'.788gitlab # [ 5.798175] systemd[1]: Started Rule-based Manager for Device Events and Files.789gitlab # [ 5.801169] systemd[1]: Finished Coldplug All udev Devices.790gitlab # [ 5.867548] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse791gitlab # [ 5.885332] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.792gitlab # [ 5.896361] (udev-worker)[420]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.793gitlab # [ 5.898797] (udev-worker)[420]: Network interface NamePolicy= disabled on kernel command line.794gitlab # [ 5.901779] (udev-worker)[441]: Network interface NamePolicy= disabled on kernel command line.795gitlab # [ 5.902973] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.796gitlab # [ 5.919905] systemd[1]: Condition check resulted in Virtio network device being skipped.797gitlab # [ 5.921165] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore798gitlab # [ 5.922653] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67799gitlab # [ 5.924767] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore800gitlab # [ 5.926315] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os801gitlab # [ 5.927855] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os802gitlab # [ 5.937992] systemd[1]: Finished Firewall.803gitlab # [ 6.107158] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3804gitlab # [ 6.136775] Floppy drive(s): fd0 is 2.88M AMI BIOS805gitlab # [ 6.136881] parport_pc 00:03: reported by Plug and Play ACPI806gitlab # [ 6.136904] rtc_cmos 00:05: RTC can wake from S4807gitlab # [ 6.140526] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]808gitlab # [ 6.141651] ACPI: button: Power Button [PWRF]809gitlab # [ 6.143301] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console810gitlab # [ 6.153431] FDC 0 is a S82078B811gitlab # [ 6.157013] rtc_cmos 00:05: registered as rtc0812gitlab # [ 6.157093] rtc_cmos 00:05: setting system clock to 2026-11-07T12:09:00 UTC (1794053340)813gitlab # [ 6.157907] Console: switching to colour dummy device 80x25814gitlab # [ 6.158880] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs815gitlab # [ 6.161583] [drm] Found bochs VGA, ID 0xb0c5.816gitlab # [ 6.162532] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.817gitlab # [ 6.163371] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0818gitlab # [ 6.164487] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD819gitlab # [ 6.164592] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic820gitlab # [ 6.166083] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0821gitlab # [ 6.175732] systemd-journald[321]: Time jumped backwards, rotating.822gitlab # [ 6.178157] Console: switching to colour frame buffer device 160x50823gitlab # [ 6.180488] mousedev: PS/2 mouse device common for all mice824gitlab # [ 6.181495] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device825gitlab # [ 6.186264] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5826gitlab # [ 6.192273] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4827gitlab # [ 6.116202] systemd[1]: Starting Virtual Console Setup...828gitlab # [ 6.123338] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.829gitlab # [ 6.126667] systemd[1]: Stopped Virtual Console Setup.830gitlab # [ 6.144095] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 6.309449] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6832gitlab # [ 6.166494] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.833gitlab # [ 6.179024] systemd[1]: Stopped Virtual Console Setup.834gitlab # [ 6.335235] kvm_amd: TSC scaling supported835gitlab # [ 6.335670] kvm_amd: Nested Virtualization enabled836gitlab # [ 6.336113] ppdev: user-space parallel port driver837gitlab # [ 6.336554] kvm_amd: Nested Paging enabled838gitlab # [ 6.186686] systemd[1]: Starting Virtual Console Setup...839gitlab # [ 6.338172] kvm_amd: LBR virtualization supported840gitlab # [ 6.338662] kvm_amd: Virtual VMLOAD VMSAVE supported841gitlab # [ 6.339579] kvm_amd: Virtual GIF supported842gitlab # [ 6.340239] kvm_amd: Virtual NMI enabled843gitlab # [ 6.372401] EDAC MC: Ver: 3.0.0844gitlab # [ 6.247333] systemd-vconsole-setup[495]: Configuration of first virtual console was skipped, ignoring remaining ones.845gitlab # [ 6.249752] systemd[1]: Finished Virtual Console Setup.846gitlab # [ 6.539088] systemd[1]: Mounting /run/wrappers...847gitlab # [ 6.551598] systemd[1]: Mounted /run/wrappers.848gitlab # [ 6.553974] systemd[1]: Reached target Local File Systems.849gitlab # [ 6.556935] systemd[1]: Listening on Boot Loader Control Service Socket.850gitlab # [ 6.560945] systemd[1]: Starting register-nix-paths.service...851gitlab # [ 6.573079] systemd[1]: Starting Create SUID/SGID Wrappers...852gitlab # [ 6.574773] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.853gitlab # [ 6.579141] systemd[1]: Starting Save Transient machine-id to Disk...854gitlab # [ 6.581057] systemd[1]: Starting Create System Files and Directories...855gitlab # [ 6.593445] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.856gitlab # [ 6.596557] systemd[1]: Finished Save Transient machine-id to Disk.857gitlab # [ 6.602311] systemd[1]: Finished Create System Files and Directories.858gitlab # [ 6.606243] systemd[1]: Starting Rebuild Journal Catalog...859gitlab # [ 6.608388] systemd[1]: Starting Record System Boot/Shutdown in UTMP...860gitlab # [ 6.623539] systemd[1]: Finished Record System Boot/Shutdown in UTMP.861gitlab # [ 6.634607] systemd[1]: Finished Rebuild Journal Catalog.862gitlab # [ 6.636080] systemd[1]: Starting Update is Completed...863gitlab # [ 6.651967] systemd[1]: Finished Update is Completed.864gitlab # [ 6.677386] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.865gitlab # [ 6.678777] systemd[1]: Finished Create SUID/SGID Wrappers.866gitlab # [ 6.985708] systemd[1]: Finished register-nix-paths.service.867gitlab # [ 6.988767] systemd[1]: Reached target System Initialization.868gitlab # [ 6.991312] systemd[1]: Started Discard unused filesystem blocks once a week.869gitlab # [ 6.993824] systemd[1]: Started logrotate.timer.870gitlab # [ 6.995449] systemd[1]: Started Daily Cleanup of Temporary Directories.871gitlab # [ 6.997682] systemd[1]: Reached target Timer Units.872gitlab # [ 6.999411] systemd[1]: Listening on D-Bus System Message Bus Socket.873gitlab # [ 7.001503] systemd[1]: Listening on Nix Daemon Socket.874gitlab # [ 7.015253] systemd[1]: Starting nixbot CI service socket...875gitlab # [ 7.017271] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.876gitlab # [ 7.020136] systemd[1]: Listening on nixbot CI service socket.877gitlab # [ 7.022206] systemd[1]: Reached target Socket Units.878gitlab # [ 7.024118] systemd[1]: Starting D-Bus System Message Bus...879gitlab # [ 7.084877] dbus-broker-launch[577]: Looking up NSS user entry for 'systemd-timesync'...880gitlab # [ 7.087984] dbus-broker-launch[577]: NSS returned no entry for 'systemd-timesync'881gitlab # [ 7.090675] dbus-broker-launch[577]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"882gitlab # [ 7.096358] systemd[1]: Started D-Bus System Message Bus.883gitlab # [ 7.098894] dbus-broker-launch[577]: Ready884gitlab # [ 7.104880] systemd[1]: Reached target Basic System.885gitlab # [ 7.108902] systemd[1]: Started backdoor.service.886gitlab # [ 7.112022] systemd[1]: Starting gitlab-config.service...887gitlab # [ 7.122080] systemd[1]: Starting Import lastlog data into lastlog2 database...888gitlab # [ 7.125890] systemd[1]: Starting Logrotate configuration check...889gitlab # [ 7.128259] systemd[1]: Starting Name Service Cache Daemon (nsncd)...890gitlab # connecting to host...891gitlab # [ 7.136207] systemd[1]: Starting Post-Boot Actions...892gitlab # [ 7.139183] systemd[1]: Started Reset console on configuration changes.893gitlab # [ 7.140705] logrotate[582]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.894gitlab # [ 7.141729] logrotate[582]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf895gitlab # [ 7.142645] logrotate[582]: note: 'monthly' overrides previously specified 'weekly'896gitlab # [ 7.143599] systemd[1]: Starting resolvconf update...897gitlab # [ 7.146140] logrotate[582]: Reading state from file: /var/lib/logrotate.status898gitlab # [ 7.147125] logrotate[582]: state file /var/lib/logrotate.status does not exist899gitlab # [ 7.148279] logrotate[582]: Allocating hash table for state file, size 64 entries900gitlab # [ 7.149083] logrotate[582]: Handling 4 logs901gitlab: Guest shell says: b'Spawning backdoor root shell...\n'902gitlab # [ 7.149823] logrotate[582]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed903gitlab # [ 7.150906] logrotate[582]: considering log /var/log/btmp904gitlab: connected to guest root shell905gitlab # [ 7.151698] logrotate[582]: Creating new state906gitlab: (connecting took 7.75 seconds)907gitlab # [ 7.152486] logrotate[582]: Now: 2026-11-07 12:09908gitlab: (finished: waiting for the VM to finish booting, in 7.75 seconds)909gitlab # [ 7.153147] logrotate[582]: Last rotated at 2026-11-07 12:00910gitlab # [ 7.153886] logrotate[582]: log does not need rotating (log has already been rotated)911gitlab # [ 7.154673] logrotate[582]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed912gitlab # [ 7.155522] logrotate[582]: considering log /var/log/wtmp913gitlab # [ 7.156274] logrotate[582]: Creating new state914gitlab # [ 7.157047] logrotate[582]: Now: 2026-11-07 12:09915gitlab # [ 7.157654] logrotate[582]: Last rotated at 2026-11-07 12:00916gitlab # [ 7.158417] logrotate[582]: log does not need rotating (log has already been rotated)917gitlab # [ 7.159058] logrotate[582]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed918gitlab # [ 7.159673] logrotate[582]: switching euid from 0 to 165 and egid from 0 to 165 (pid 582)919gitlab # [ 7.160439] logrotate[582]: considering log /var/gitlab/state/log/*.log920gitlab # [ 7.161057] logrotate[582]: log /var/gitlab/state/log/*.log does not exist -- skipping921gitlab # [ 7.161530] logrotate[582]: Creating new state922gitlab # [ 7.162151] logrotate[582]: switching euid from 165 to 0 and egid from 165 to 0 (pid 582)923gitlab # [ 7.162765] logrotate[582]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed924gitlab # [ 7.163169] logrotate[582]: switching euid from 0 to 60 and egid from 0 to 60 (pid 582)925gitlab # [ 7.163769] logrotate[582]: considering log /var/log/nginx/*.log926gitlab # [ 7.164797] logrotate[582]: log /var/log/nginx/*.log does not exist -- skipping927gitlab # [ 7.165455] logrotate[582]: Creating new state928gitlab # [ 7.166121] logrotate[582]: not running postrotate script, since no logs were rotated929gitlab # [ 7.166748] logrotate[582]: switching euid from 60 to 0 and egid from 60 to 0 (pid 582)930gitlab # [ 7.181329] systemd[1]: Finished Logrotate configuration check.931gitlab # [ 7.182296] systemd[1]: Finished Post-Boot Actions.932gitlab # [ 7.191803] systemd[1]: Finished Import lastlog data into lastlog2 database.933gitlab # [ 7.197734] nsncd[583]: Nov 07 12:09:01.691 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"934gitlab # [ 7.198637] systemd[1]: Started Name Service Cache Daemon (nsncd).935gitlab # [ 7.199180] systemd[1]: Reached target Host and Network Name Lookups.936gitlab # [ 7.199636] systemd[1]: Reached target User and Group Name Lookups.937gitlab # [ 7.207527] systemd[1]: Starting User Login Management...938gitlab # [ 7.225910] systemd[1]: Stopped target Host and Network Name Lookups.939gitlab # [ 7.226649] systemd[1]: Stopping Host and Network Name Lookups...940gitlab # [ 7.227659] systemd[1]: Stopped target User and Group Name Lookups.941gitlab # [ 7.228419] systemd[1]: Stopping User and Group Name Lookups...942gitlab # [ 7.229102] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...943gitlab # [ 7.231055] systemd[1]: nscd.service: Deactivated successfully.944gitlab # [ 7.231530] systemd[1]: Stopped Name Service Cache Daemon (nsncd).945gitlab # [ 7.231852] systemd[1]: nscd.service: Consumed 11ms CPU time over 102ms wall clock time, 7.3M memory peak, 5.5M read from disk.946gitlab # [ 7.235340] systemd[1]: Starting Name Service Cache Daemon (nsncd)...947gitlab # [ 7.245095] systemd-logind[641]: New seat seat0.948gitlab # [ 7.251050] systemd-logind[641]: Watching system buttons on /dev/input/event2 (Power Button)949gitlab # [ 7.251634] systemd-logind[641]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)950gitlab # [ 7.252159] nsncd[672]: Nov 07 12:09:01.745 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"951gitlab # [ 7.254610] systemd-logind[641]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)952gitlab # [ 7.257588] systemd[1]: Started User Login Management.953gitlab # [ 7.257889] systemd[1]: Started Name Service Cache Daemon (nsncd).954gitlab # [ 7.258376] systemd[1]: Reached target Host and Network Name Lookups.955gitlab # [ 7.258866] systemd[1]: Reached target User and Group Name Lookups.956gitlab # [ 7.259555] systemd[1]: Starting linger-users.service...957gitlab # [ 7.270543] systemd[1]: Finished resolvconf update.958gitlab # [ 7.271318] systemd[1]: Reached target Preparation for Network.959gitlab # [ 7.273809] systemd[1]: Starting DHCP Client...960gitlab # [ 7.274647] systemd[1]: Starting Address configuration of eth1...961gitlab # [ 7.278065] systemd[1]: Starting Extra networking commands....962gitlab # [ 7.279759] systemd[1]: linger-users.service: Deactivated successfully.963gitlab # [ 7.283266] systemd[1]: Finished linger-users.service.964gitlab # [ 7.298696] network-addresses-eth1-start[699]: adding address 192.168.1.1/24... done965gitlab # [ 7.303134] network-addresses-eth1-start[699]: adding address 2001:db8:1::1/64... done966gitlab # [ 7.307921] systemd[1]: Finished Address configuration of eth1.967gitlab # [ 7.337635] systemd[1]: Finished Extra networking commands..968gitlab # [ 7.338916] systemd[1]: Reached target Network.969gitlab # [ 7.340604] systemd[1]: Starting gitlab-workhorse.service...970gitlab # [ 7.342418] systemd[1]: Starting Nginx Web Server...971gitlab # [ 7.344498] dhcpcd[717]: dhcpcd-10.3.2 starting972gitlab # [ 7.346066] systemd[1]: Starting PostgreSQL Server...973gitlab # [ 7.348347] systemd[1]: Starting Redis Server - redis-gitlab...974gitlab # [ 7.349071] dhcpcd[768]: dev: loaded udev975gitlab # [ 7.352077] systemd[1]: Starting Permit User Sessions...976gitlab # [ 7.504428] 8021q: 802.1Q VLAN Support v1.8977gitlab # [ 7.505015] 8021q: adding VLAN 0 to HW filter on device eth1978gitlab # [ 7.367290] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.979gitlab # [ 7.368669] systemd[1]: Finished Permit User Sessions.980gitlab # [ 7.371421] systemd[1]: Started Getty on tty1.981gitlab # [ 7.376331] systemd[1]: Reached target Login Prompts.982gitlab # [ 7.601215] cfg80211: Loading compiled-in X.509 certificates for regulatory database983gitlab # [ 7.607491] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'984gitlab # [ 7.608789] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'985gitlab # [ 7.610748] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2986gitlab # [ 7.612010] cfg80211: failed to load regulatory.db987gitlab # [ 7.465301] nginx-pre-start[790]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok988gitlab # [ 7.466046] nginx-pre-start[790]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful989gitlab # [ 7.472061] systemd[1]: Started Nginx Web Server.990gitlab # [ 7.479512] redis-server[788]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.991gitlab # [ 7.480200] redis-server[788]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo992gitlab # [ 7.480791] redis-server[788]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=788, just started993gitlab # [ 7.481215] redis-server[788]: Configuration loaded994gitlab # [ 7.481713] redis[788]: monotonic clock: POSIX clock_gettime995gitlab # [ 7.482459] redis[788]: Running mode=standalone, port=0.996gitlab # [ 7.483022] redis[788]: Server initialized997gitlab # [ 7.483430] redis[788]: Ready to accept connections unix998gitlab # [ 7.483894] systemd[1]: Started Redis Server - redis-gitlab.999gitlab # [ 7.484534] redis[788]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1000gitlab # [ 7.640435] 8021q: adding VLAN 0 to HW filter on device eth01001gitlab # [ 7.490890] dhcpcd[768]: eth0: waiting for carrier1002gitlab # [ 7.492371] dhcpcd[768]: eth0: carrier acquired1003gitlab # [ 7.493691] postgresql-pre-start[794]: The files belonging to this database system will be owned by user "postgres".1004gitlab # [ 7.494678] postgresql-pre-start[794]: This user must also own the server process.1005gitlab # [ 7.496170] postgresql-pre-start[794]: The database cluster will be initialized with locale "en_US.UTF-8".1006gitlab # [ 7.496711] postgresql-pre-start[794]: The default database encoding has accordingly been set to "UTF8".1007gitlab # [ 7.497542] postgresql-pre-start[794]: The default text search configuration will be set to "english".1008gitlab # [ 7.497737] postgresql-pre-start[794]: Data page checksums are enabled.1009gitlab # [ 7.498583] postgresql-pre-start[794]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1010gitlab # [ 7.499020] postgresql-pre-start[794]: creating subdirectories ... ok1011gitlab # [ 7.499544] postgresql-pre-start[794]: selecting dynamic shared memory implementation ... posix1012gitlab # [ 7.504536] dhcpcd[768]: DUID 00:01:00:01:32:81:d1:5d:52:54:00:12:34:561013gitlab # [ 7.505280] dhcpcd[768]: eth0: IAID 00:12:34:561014gitlab # [ 7.505788] dhcpcd[768]: eth0: adding address fe80::5054:ff:fe12:34561015gitlab # [ 7.529151] postgresql-pre-start[794]: selecting default "max_connections" ... 1001016gitlab # [ 7.563029] postgresql-pre-start[794]: selecting default "shared_buffers" ... 128MB1017gitlab # [ 7.815291] systemd[1]: Started gitlab-workhorse.service.1018gitlab # [ 7.916228] postgresql-pre-start[794]: selecting default time zone ... UTC1019gitlab # [ 7.918355] postgresql-pre-start[794]: creating configuration files ... ok1020gitlab # [ 7.995267] gitlab-workhorse[825]: time="2026-11-07T12:09:02Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41021gitlab # [ 7.995834] gitlab-workhorse[825]: time="2026-11-07T12:09:02Z" level=info msg="Using redis/go-redis"1022gitlab # [ 7.996445] gitlab-workhorse[825]: time="2026-11-07T12:09:02Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1023gitlab # [ 8.070590] postgresql-pre-start[794]: running bootstrap script ... ok1024gitlab # [ 8.132292] dhcpcd[768]: eth0: soliciting a DHCP lease1025gitlab # [ 8.289394] NET: Registered PF_PACKET protocol family1026gitlab # [ 8.144736] dhcpcd[768]: eth0: offered 10.0.2.15 from 10.0.2.21027gitlab # [ 8.153212] dhcpcd[768]: eth0: probing address 10.0.2.15/241028gitlab # [ 8.469869] postgresql-pre-start[794]: performing post-bootstrap initialization ... ok1029gitlab # [ 8.791377] postgresql-pre-start[794]: syncing data to disk ... ok1030gitlab # [ 8.793101] postgresql-pre-start[794]: initdb: warning: enabling "trust" authentication for local connections1031gitlab # [ 8.794467] postgresql-pre-start[794]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1032gitlab # [ 8.796433] postgresql-pre-start[794]: Success. You can now start the database server using:1033gitlab # [ 8.798041] postgresql-pre-start[794]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1034gitlab # [ 8.913561] postgres[851]: [851] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1035gitlab # [ 8.915695] postgres[851]: [851] LOG: listening on IPv6 address "::1", port 54321036gitlab # [ 8.916582] postgres[851]: [851] LOG: listening on IPv4 address "127.0.0.1", port 54321037gitlab # [ 8.920863] postgres[851]: [851] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1038gitlab # [ 8.933133] postgres[861]: [861] LOG: database system was shut down at 2026-11-07 12:09:02 GMT1039gitlab # [ 8.940107] postgres[851]: [851] LOG: database system is ready to accept connections1040gitlab # [ 8.944420] systemd[1]: Started PostgreSQL Server.1041gitlab # [ 8.947514] systemd[1]: Starting PostgreSQL Setup Scripts...1042gitlab # [ 9.085925] postgresql-setup-start[872]: CREATE DATABASE1043gitlab # [ 9.113581] postgresql-setup-start[882]: CREATE ROLE1044gitlab # [ 9.121705] postgresql-setup-start[884]: ALTER DATABASE1045gitlab # [ 9.134480] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[877]: mkdir -p /var/gitlab/state/home/.ssh: OK1046gitlab # [ 9.135741] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[877]: chmod 700 /var/gitlab/state/home/.ssh: OK1047gitlab # [ 9.146668] postgresql-setup-start[889]: CREATE ROLE1048gitlab # [ 9.149276] systemd[1]: Finished PostgreSQL Setup Scripts.1049gitlab # [ 9.149959] systemd[1]: Reached target PostgreSQL.1050gitlab # [ 9.151157] systemd[1]: Starting gitlab-postgresql.service...1051gitlab # [ 9.171736] systemd[1]: Finished gitlab-config.service.1052gitlab # [ 9.174537] systemd[1]: Started gitaly.service.1053gitlab # [ 9.175435] systemd[1]: Starting gitlab-db-config.service...1054gitlab # [ 9.229752] gitlab-postgresql-start[911]: CREATE DATABASE1055gitlab # [ 9.265514] gitlab-postgresql-start[918]: CREATE EXTENSION1056gitlab # [ 9.342169] gitlab-postgresql-start[924]: CREATE EXTENSION1057gitlab # [ 9.344744] systemd[1]: Finished gitlab-postgresql.service.1058gitlab # [ 9.614612] gitaly[909]: time="2026-11-07T12:09:04.107Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9091059gitlab # [ 9.615320] gitaly[909]: time="2026-11-07T12:09:04.108Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9091060gitlab # [ 9.615421] gitaly[909]: time="2026-11-07T12:09:04.108Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9091061gitlab # [ 9.615845] gitaly[909]: time="2026-11-07T12:09:04.108Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9091062gitlab # [ 9.616470] gitaly[909]: time="2026-11-07T12:09:04.108Z" level=info msg="Starting Gitaly" pid=909 version=1063gitlab # [ 9.791098] gitaly[909]: time="2026-11-07T12:09:04.284Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=175 pid=9091064gitlab # [ 9.791970] gitaly[909]: time="2026-11-07T12:09:04.284Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9091065gitlab # [ 9.794770] gitaly[909]: time="2026-11-07T12:09:04.288Z" level=info msg="finished initializing command factory" duration_ms=3 pid=9091066gitlab # [ 9.795645] gitaly[909]: time="2026-11-07T12:09:04.288Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-909/git-exec-2955425148.d/git pid=9091067gitlab # [ 9.802181] gitaly[909]: time="2026-11-07T12:09:04.295Z" level=info msg="finished detecting git version" duration_ms=7 pid=9091068gitlab # [ 9.802953] gitaly[909]: time="2026-11-07T12:09:04.295Z" level=info msg="using Git version" pid=909 version=2.53.g1069gitlab # [ 9.805573] gitaly[909]: time="2026-11-07T12:09:04.299Z" level=info msg="clearing disk cache object folder" pid=909 storage=default1070gitlab # [ 9.807500] gitaly[909]: time="2026-11-07T12:09:04.299Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache688990985 pid=909 storage=default1071gitlab # [ 9.810367] gitaly[909]: time="2026-11-07T12:09:04.299Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache688990985 pid=909 storage=default1072gitlab # [ 9.810987] gitaly[909]: time="2026-11-07T12:09:04.299Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9091073gitlab # [ 9.811555] gitaly[909]: time="2026-11-07T12:09:04.299Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9091074gitlab # [ 9.812065] gitaly[909]: time="2026-11-07T12:09:04.299Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache688990985 clear_duration_ms=0 pid=909 storage=default1075gitlab # [ 9.837122] gitaly[909]: time="2026-11-07T12:09:04.330Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9091076gitlab # [ 9.837883] gitaly[909]: time="2026-11-07T12:09:04.330Z" level=info msg="counting repositories" pid=9091077gitlab # [ 9.838240] gitaly[909]: time="2026-11-07T12:09:04.330Z" level=info msg="starting to count repositories" pid=909 storage_path=/var/gitlab/state/repositories1078gitlab # [ 9.838420] gitaly[909]: time="2026-11-07T12:09:04.330Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=909 schema=unix1079gitlab # [ 9.838969] gitaly[909]: time="2026-11-07T12:09:04.330Z" level=info msg="finished tempdir cleaner walk" pid=909 storage=default time_ms=01080gitlab # [ 9.839367] gitaly[909]: time="2026-11-07T12:09:04.330Z" level=info msg="listening at address" address=/run/gitaly/gitaly-909/sock.d/intern pid=909 schema=unix1081gitlab # [ 9.839931] gitaly[909]: time="2026-11-07T12:09:04.330Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=909 storage_path=/var/gitlab/state/repositories1082gitlab # [ 9.840658] gitaly[909]: time="2026-11-07T12:09:04.330Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9091083gitlab # [ 9.852904] gitaly[909]: time="2026-11-07T12:09:04.346Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9091084gitlab # [ 9.853883] gitaly[909]: time="2026-11-07T12:09:04.346Z" level=info msg="Started Gitaly" duration_ms=238 pid=9091085gitlab # [ 9.856182] gitaly[909]: time="2026-11-07T12:09:04.346Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9091086gitlab # [ 9.856970] gitaly[909]: time="2026-11-07T12:09:04.347Z" level=info msg="maintenance: daily scheduled" pid=909 scheduled="2026-11-08 12:00:00 +0000 UTC"1087gitlab # [ 10.403960] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1088gitlab # [ 10.405792] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1089gitlab # [ 10.439342] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1090gitlab # [ 10.466715] dhcpcd[768]: eth0: soliciting an IPv6 router1091gitlab # [ 10.468897] dhcpcd[768]: eth0: Router Advertisement from fe80::21092gitlab # [ 10.469956] dhcpcd[768]: eth0: adding address fec0::5054:ff:fe12:3456/641093gitlab # [ 10.470883] dhcpcd[768]: eth0: adding route to fec0::/641094gitlab # [ 10.471681] dhcpcd[768]: eth0: adding default route via fe80::21095gitlab # [ 11.784259] gitaly[909]: time="2026-11-07T12:09:06.276Z" level=info msg="License database preloaded" duration_ms=2168 pid=9091096gitlab # [ 12.725188] dhcpcd[768]: eth0: leased 10.0.2.15 for 86400 seconds1097gitlab # [ 12.727330] dhcpcd[768]: eth0: adding route to 10.0.2.0/241098gitlab # [ 12.729129] dhcpcd[768]: eth0: adding default route via 10.0.2.21099gitlab # [ 12.843415] systemd[1]: Started DHCP Client.1100gitlab # [ 12.845997] systemd[1]: Reached target Network is Online.1101gitlab # [ 40.028824] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: W, [2026-11-07T12:09:34.521672 #914] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1102gitlab # [ 42.131927] postgres[1310]: [1310] ERROR: relation "feature_gates" does not exist at character 5231103gitlab # [ 42.133437] postgres[1310]: [1310] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1104gitlab # [ 42.134869] postgres[1310]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1105gitlab # [ 42.137181] postgres[1310]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1106gitlab # [ 42.137980] postgres[1310]: attidentity AS identity,1107gitlab # [ 42.140323] postgres[1310]: attgenerated as attgenerated1108gitlab # [ 42.142258] postgres[1310]: FROM pg_attribute a1109gitlab # [ 42.143446] postgres[1310]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1110gitlab # [ 42.145409] postgres[1310]: LEFT JOIN pg_type t ON a.atttypid = t.oid1111gitlab # [ 42.147292] postgres[1310]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1112gitlab # [ 42.148841] postgres[1310]: WHERE a.attrelid = '"feature_gates"'::regclass1113gitlab # [ 42.150072] postgres[1310]: AND a.attnum > 0 AND NOT a.attisdropped1114gitlab # [ 42.151956] postgres[1310]: ORDER BY a.attnum1115gitlab # [ 42.154345] postgres[1310]:1116gitlab # [ 45.401356] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1343]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1117gitlab # [ 45.406093] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1343]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1118gitlab # [ 48.027383] gitlab-workhorse[825]: time="2026-11-07T12:09:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1119gitlab # [ 58.037543] gitlab-workhorse[825]: time="2026-11-07T12:09:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1120gitlab # [ 60.248765] postgres[1409]: [1409] ERROR: relation "table_without_models" does not exist1121gitlab # [ 60.249794] postgres[1409]: [1409] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1122gitlab # [ 68.046445] gitlab-workhorse[825]: time="2026-11-07T12:10:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1123gitlab # [ 72.107323] systemd[1]: Finished gitlab-db-config.service.1124gitlab # [ 72.111745] systemd[1]: Started gitlab-sidekiq.service.1125gitlab # [ 72.114756] systemd[1]: Starting gitlab.service...1126gitlab # [ 72.473897] bundle[1585]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1127gitlab # [ 72.478741] bundle[1585]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1128gitlab # [ 72.483375] bundle[1585]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1129gitlab # [ 75.140611] sidekiq-cluster[1584]: {"severity":"INFO","time":"2026-11-07T12:10:09.617Z","message":"Starting cluster with 1 processes"}1130gitlab # [ 75.248864] bundle[1585]: {"timestamp":"2026-11-07T12:10:09.722Z","pid":1585,"message":"* Enabling systemd notification integration"}1131gitlab # [ 75.252921] bundle[1585]: {"timestamp":"2026-11-07T12:10:09.741Z","pid":1585,"message":"Puma starting in cluster mode..."}1132gitlab # [ 75.256379] bundle[1585]: {"timestamp":"2026-11-07T12:10:09.741Z","pid":1585,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1133gitlab # [ 75.259959] bundle[1585]: {"timestamp":"2026-11-07T12:10:09.741Z","pid":1585,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1134gitlab # [ 75.264605] bundle[1585]: {"timestamp":"2026-11-07T12:10:09.741Z","pid":1585,"message":"* Min threads: 0"}1135gitlab # [ 75.267816] bundle[1585]: {"timestamp":"2026-11-07T12:10:09.741Z","pid":1585,"message":"* Max threads: 4"}1136gitlab # [ 75.270857] bundle[1585]: {"timestamp":"2026-11-07T12:10:09.741Z","pid":1585,"message":"* Environment: production"}1137gitlab # [ 75.274146] bundle[1585]: {"timestamp":"2026-11-07T12:10:09.741Z","pid":1585,"message":"* Master PID: 1585"}1138gitlab # [ 75.277281] bundle[1585]: {"timestamp":"2026-11-07T12:10:09.741Z","pid":1585,"message":"* Workers: 2"}1139gitlab # [ 75.280294] bundle[1585]: {"timestamp":"2026-11-07T12:10:09.741Z","pid":1585,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1140gitlab # [ 75.284086] bundle[1585]: {"timestamp":"2026-11-07T12:10:09.741Z","pid":1585,"message":"* Preloading application"}1141gitlab # [ 78.056713] gitlab-workhorse[825]: time="2026-11-07T12:10:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1142gitlab # [ 88.057306] gitlab-workhorse[825]: time="2026-11-07T12:10:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143gitlab # [ 97.536184] bundle[1585]: W, [2026-11-07T12:10:32.028792 #1585] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1144gitlab # [ 98.070603] gitlab-workhorse[825]: time="2026-11-07T12:10:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145gitlab # [ 100.074671] sidekiq-cluster[1615]: 2026-11-07T12:10:34.567Z pid=1615 tid=wkn INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1615, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433979392}1146gitlab # [ 100.245641] sidekiq-cluster[1615]: W, [2026-11-07T12:10:34.739015 #1615] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1147gitlab # [ 100.286735] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:34.779Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1148gitlab # [ 102.092157] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.584Z","message":"GitLab reliable fetch activated!"}1149gitlab # [ 102.093300] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.585Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1150gitlab # [ 102.118231] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.611Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1151gitlab # [ 102.122721] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.616Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1152gitlab # [ 102.127292] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.620Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1153gitlab # [ 102.131752] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.625Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1154gitlab # [ 102.137309] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.630Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1155gitlab # [ 102.144213] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.637Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1156gitlab # [ 102.149645] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.643Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1157gitlab # [ 102.154830] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.648Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1158gitlab # [ 102.160084] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.653Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1159gitlab # [ 102.165360] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.658Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1160gitlab # [ 102.170868] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.664Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1161gitlab # [ 102.177445] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.670Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1162gitlab # [ 102.182672] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.676Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1163gitlab # [ 102.187973] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.681Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1164gitlab # [ 102.193965] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.687Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1165gitlab # [ 102.199997] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.693Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1166gitlab # [ 102.206820] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.700Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1167gitlab # [ 102.213544] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.706Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1168gitlab # [ 102.220089] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.713Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1169gitlab # [ 102.226458] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.719Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1170gitlab # [ 102.233090] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.726Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1171gitlab # [ 102.238695] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.732Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1172gitlab # [ 102.244121] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.737Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1173gitlab # [ 102.250549] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.743Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1174gitlab # [ 102.258919] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.752Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1175gitlab # [ 102.264145] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.757Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1176gitlab # [ 102.269342] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.762Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1177gitlab # [ 102.275086] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.768Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1178gitlab # [ 102.281506] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.774Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1179gitlab # [ 102.285475] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.778Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1180gitlab # [ 102.289052] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.782Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1181gitlab # [ 102.292035] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.785Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1182gitlab # [ 102.294655] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.788Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1183gitlab # [ 102.297088] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.790Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1184gitlab # [ 102.299533] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.793Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1185gitlab # [ 102.301837] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.795Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1186gitlab # [ 102.304424] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.797Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1187gitlab # [ 102.307178] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.800Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1188gitlab # [ 102.309481] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.802Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1189gitlab # [ 102.311493] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.805Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1190gitlab # [ 102.313960] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.807Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1191gitlab # [ 102.317252] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.810Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1192gitlab # [ 102.320572] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.814Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1193gitlab # [ 102.324127] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.817Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1194gitlab # [ 102.327919] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.821Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1195gitlab # [ 102.331038] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.824Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1196gitlab # [ 102.333828] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.827Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1197gitlab # [ 102.337169] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.830Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1198gitlab # [ 102.340781] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.834Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1199gitlab # [ 102.343343] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.836Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1200gitlab # [ 102.345524] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.839Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1201gitlab # [ 102.348119] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.841Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1202gitlab # [ 102.356595] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.850Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1203gitlab # [ 102.359128] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.852Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1204gitlab # [ 102.361538] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.855Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1205gitlab # [ 102.363825] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.857Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1206gitlab # [ 102.365952] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.859Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1207gitlab # [ 102.368465] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.862Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1208gitlab # [ 102.370485] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.864Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1209gitlab # [ 102.372711] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.866Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1210gitlab # [ 102.374984] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.868Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1211gitlab # [ 102.376925] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.870Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1212gitlab # [ 102.379633] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.873Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1213gitlab # [ 102.382249] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.875Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1214gitlab # [ 102.384477] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.878Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1215gitlab # [ 102.386872] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.880Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1216gitlab # [ 102.388766] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.882Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1217gitlab # [ 102.420594] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.914Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1218gitlab # [ 102.422645] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.916Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1219gitlab # [ 102.424973] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.918Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1220gitlab # [ 102.426926] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.920Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1221gitlab # [ 102.429782] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.923Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1222gitlab # [ 102.431835] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.925Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1223gitlab # [ 102.433681] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.927Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1224gitlab # [ 102.436199] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.929Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1225gitlab # [ 102.438182] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.931Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1226gitlab # [ 102.440698] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.934Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1227gitlab # [ 102.442757] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.936Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1228gitlab # [ 102.445165] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.938Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1229gitlab # [ 102.446978] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.940Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1230gitlab # [ 102.449039] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.942Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1231gitlab # [ 102.451021] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.944Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1232gitlab # [ 102.453387] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.946Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1233gitlab # [ 102.455691] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.949Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1234gitlab # [ 102.457982] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.951Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1235gitlab # [ 102.460248] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.953Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1236gitlab # [ 102.462448] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.955Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1237gitlab # [ 102.464700] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.958Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1238gitlab # [ 102.466730] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.960Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1239gitlab # [ 102.468995] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.962Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1240gitlab # [ 102.470843] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.964Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1241gitlab # [ 102.473063] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.966Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1242gitlab # [ 102.474923] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.968Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1243gitlab # [ 102.477204] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.970Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1244gitlab # [ 102.479705] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.973Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1245gitlab # [ 102.482524] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.976Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1246gitlab # [ 102.484383] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.977Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1247gitlab # [ 102.486271] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.979Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1248gitlab # [ 102.493745] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.987Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1249gitlab # [ 102.495835] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.989Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1250gitlab # [ 102.497658] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.991Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1251gitlab # [ 102.500795] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.994Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1252gitlab # [ 102.503116] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.996Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1253gitlab # [ 102.505675] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:36.999Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1254gitlab # [ 102.508123] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:37.001Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1255gitlab # [ 102.510428] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:37.003Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1256gitlab # [ 102.512232] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:37.005Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1257gitlab # [ 102.514947] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:37.008Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1258gitlab # [ 102.516786] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:10:37.010Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1259gitlab # [ 105.400199] sidekiq-cluster[1615]: InitializerConnections Query: SET client_min_messages TO 'warning'1260gitlab # [ 105.401472] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1261gitlab # [ 105.402808] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1262gitlab # [ 105.403757] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1263gitlab # [ 105.404652] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1264gitlab # [ 105.405548] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1265gitlab # [ 105.406297] sidekiq-cluster[1615]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1266gitlab # [ 105.407171] sidekiq-cluster[1615]: InitializerConnections Query: SET standard_conforming_strings = on1267gitlab # [ 105.408007] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1268gitlab # [ 105.408745] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1269gitlab # [ 105.409505] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1270gitlab # [ 105.410289] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1271gitlab # [ 105.411046] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1272gitlab # [ 105.411781] sidekiq-cluster[1615]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1273gitlab # [ 105.412760] sidekiq-cluster[1615]: InitializerConnections Query: SET intervalstyle = iso_86011274gitlab # [ 105.413663] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1275gitlab # [ 105.414558] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1276gitlab # [ 105.415484] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1277gitlab # [ 105.416266] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1278gitlab # [ 105.416983] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1279gitlab # [ 105.417746] sidekiq-cluster[1615]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1280gitlab # [ 105.418733] sidekiq-cluster[1615]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1281gitlab # [ 105.430360] sidekiq-cluster[1615]: FROM pg_type as t1282gitlab # [ 105.431226] sidekiq-cluster[1615]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1283gitlab # [ 105.431928] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1284gitlab # [ 105.432978] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1285gitlab # [ 105.433786] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1286gitlab # [ 105.434581] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1287gitlab # [ 105.435241] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1288gitlab # [ 105.435888] sidekiq-cluster[1615]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1289gitlab # [ 105.436647] sidekiq-cluster[1615]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1290gitlab # [ 105.437438] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1291gitlab # [ 105.438108] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1292gitlab # [ 105.438724] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1293gitlab # [ 105.440887] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1294gitlab # [ 105.441667] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1295gitlab # [ 105.442433] sidekiq-cluster[1615]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1296gitlab # [ 105.443176] sidekiq-cluster[1615]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics'1297gitlab # [ 105.443916] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1298gitlab # [ 105.444724] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1299gitlab # [ 105.445517] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1300gitlab # [ 105.446202] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1301gitlab # [ 105.446807] sidekiq-cluster[1615]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1302gitlab # [ 105.447598] sidekiq-cluster[1615]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1303gitlab # [ 108.078526] gitlab-workhorse[825]: time="2026-11-07T12:10:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1304gitlab # [ 118.082203] gitlab-workhorse[825]: time="2026-11-07T12:10:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1305gitlab # [ 126.069147] postgres[2044]: [2044] ERROR: relation "table_without_models" does not exist1306gitlab # [ 126.070529] postgres[2044]: [2044] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1307gitlab # [ 127.983703] postgres[2064]: [2064] ERROR: relation "table_without_models" does not exist1308gitlab # [ 127.986557] postgres[2064]: [2064] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1309gitlab # [ 128.083926] gitlab-workhorse[825]: time="2026-11-07T12:11:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1310gitlab # [ 128.646616] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:03.139Z","message":"Booted Rails 7.2.3.1 application in production environment"}1311gitlab # [ 128.649599] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:03.142Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1312gitlab # [ 128.650749] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:03.143Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1313gitlab # [ 128.651816] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:03.143Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1314gitlab # [ 128.654628] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:03.148Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1315gitlab # [ 129.932690] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:04.425Z","message":"Cleaning working queues"}1316gitlab # [ 129.936501] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:04.427Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"85d179c0a42c7983f51d3382","created_at":"2026-11-07T12:10:06.266Z","trace_propagation_headers":{"sentry-trace":"4359efcefefc4bffb38237e8551b66d5-0d5d96e7b94c4596","baggage":"sentry-trace_id=4359efcefefc4bffb38237e8551b66d5,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"faafe63222c680704139cff5a3ad46e4","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-11-07T12:10:06.273Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-85d179c0a42c7983f51d3382: start","job_status":"start","queue_duration_s":58.15354,"scheduling_latency_s":58.15362}1317gitlab # [ 130.089214] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:04.582Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"85d179c0a42c7983f51d3382","created_at":"2026-11-07T12:10:06.266Z","trace_propagation_headers":{"sentry-trace":"4359efcefefc4bffb38237e8551b66d5-0d5d96e7b94c4596","baggage":"sentry-trace_id=4359efcefefc4bffb38237e8551b66d5,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"faafe63222c680704139cff5a3ad46e4","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-11-07T12:10:06.273Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-85d179c0a42c7983f51d3382: done: 0.155393 sec","job_status":"done","queue_duration_s":58.15354,"scheduling_latency_s":58.15362,"redis_calls":29,"redis_duration_s":0.0059180000000000005,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.003474,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001595,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000849,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.073343958,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.155393,"completed_at":"2026-11-07T12:11:04.582Z","load_balancing_strategy":"primary","db_duration_s":0.048309,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1318gitlab # [ 130.756218] bundle[1585]: {"timestamp":"2026-11-07T12:11:05.248Z","pid":1585,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1319gitlab # [ 130.760616] bundle[1585]: {"timestamp":"2026-11-07T12:11:05.249Z","pid":1585,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1320gitlab # [ 130.764536] bundle[1585]: {"timestamp":"2026-11-07T12:11:05.249Z","pid":1585,"message":"! #\u003cThread:0x00007572798b77f0 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1321gitlab # [ 130.775950] bundle[1585]: {"timestamp":"2026-11-07T12:11:05.249Z","pid":1585,"message":"! #\u003cThread:0x0000757279abb768 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1322gitlab # [ 130.787352] bundle[1585]: {"timestamp":"2026-11-07T12:11:05.249Z","pid":1585,"message":"Use Ctrl-C to stop"}1323gitlab # [ 130.790318] bundle[1585]: {"timestamp":"2026-11-07T12:11:05.249Z","pid":1585,"message":"Sending status to systemd every 1.0 sec"}1324gitlab # [ 131.438171] bundle[1585]: {"timestamp":"2026-11-07T12:11:05.931Z","pid":1585,"message":"- Worker 1 (PID: 2169) booted in 0.63s, phase: 0"}1325gitlab # [ 131.448883] bundle[1585]: {"timestamp":"2026-11-07T12:11:05.942Z","pid":1585,"message":"- Worker 0 (PID: 2165) booted in 0.66s, phase: 0"}1326gitlab # [ 131.453236] systemd[1]: Started gitlab.service.1327gitlab # [ 131.455224] systemd[1]: Reached target Common target for all GitLab services..1328gitlab # [ 131.457719] systemd[1]: Starting setup-gitlab.service...1329gitlab # [ 131.479640] setup-gitlab-start[2193]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1330gitlab # [ 133.450107] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:11:07 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 19391331gitlab # [ 133.457884] setup-gitlab-start[2193]: + TOKEN=nixbot-test-token-of-20-chars1332gitlab # [ 133.460455] setup-gitlab-start[2193]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1333gitlab # [ 133.473653] runuser[2211]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1334gitlab # [ 133.833783] setup-gitlab-start[2212]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1335gitlab # [ 133.838742] setup-gitlab-start[2212]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1336gitlab # [ 133.843511] setup-gitlab-start[2212]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1337gitlab # [ 134.395181] setup-gitlab-start[2212]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1338gitlab # [ 134.400108] setup-gitlab-start[2212]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1339gitlab # [ 134.404883] setup-gitlab-start[2212]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1340gitlab # [ 143.702582] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.194Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"745c8a2ec4a1c62b7f31a44d","created_at":"2026-11-07T12:11:18.166Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4beef264d9e946eed97797e34dc3d008","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-11-07T12:11:18.191Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-745c8a2ec4a1c62b7f31a44d: start","job_status":"start","queue_duration_s":0.002624,"scheduling_latency_s":0.002673}1341gitlab # [ 143.724123] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.215Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1342gitlab # [ 143.757344] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.250Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"745c8a2ec4a1c62b7f31a44d","created_at":"2026-11-07T12:11:18.166Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4beef264d9e946eed97797e34dc3d008","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-11-07T12:11:18.191Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-745c8a2ec4a1c62b7f31a44d: done: 0.056047 sec","job_status":"done","queue_duration_s":0.002624,"scheduling_latency_s":0.002673,"redis_calls":10,"redis_duration_s":0.0035919999999999997,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000681,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00211,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000801,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000594489,"duration_s":0.056047,"completed_at":"2026-11-07T12:11:18.250Z","load_balancing_strategy":"primary","db_duration_s":0.000671,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 143.809096] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.265Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"8ed8540e080167a099ed927b","created_at":"2026-11-07T12:11:18.246Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf2f856a94183a6b87b34db71491f0c8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.263Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-8ed8540e080167a099ed927b: start","job_status":"start","queue_duration_s":0.001967,"scheduling_latency_s":0.002005}1344gitlab # [ 143.822062] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.304Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1345gitlab # [ 143.829331] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.322Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"8ed8540e080167a099ed927b","created_at":"2026-11-07T12:11:18.246Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf2f856a94183a6b87b34db71491f0c8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.263Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-8ed8540e080167a099ed927b: done: 0.056971 sec","job_status":"done","queue_duration_s":0.001967,"scheduling_latency_s":0.002005,"redis_calls":10,"redis_duration_s":0.014482,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0049,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007341,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002241,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.004610363,"duration_s":0.056971,"completed_at":"2026-11-07T12:11:18.322Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000782,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 143.850877] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.324Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"4e2e6b06269045a6b6fd7f44","created_at":"2026-11-07T12:11:18.273Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c45ee599447d2f6bef66e471a5e43c46","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.288Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-4e2e6b06269045a6b6fd7f44: start","job_status":"start","queue_duration_s":0.036176,"scheduling_latency_s":0.03621}1347gitlab # [ 143.878776] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.371Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"4e2e6b06269045a6b6fd7f44","created_at":"2026-11-07T12:11:18.273Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c45ee599447d2f6bef66e471a5e43c46","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.288Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-4e2e6b06269045a6b6fd7f44: done: 0.047513 sec","job_status":"done","queue_duration_s":0.036176,"scheduling_latency_s":0.03621,"redis_calls":12,"redis_duration_s":0.016146999999999998,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000853,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002452,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.012842,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015725,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.007204547,"exclusive_lock_hold_duration_s":0.009342249,"duration_s":0.047513,"completed_at":"2026-11-07T12:11:18.371Z","load_balancing_strategy":"primary","db_duration_s":0.007166,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 143.882114] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"1ca1671d76e1bba4faf2588e","created_at":"2026-11-07T12:11:18.304Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72cc973876277c77c722951a087b008b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.344Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-1ca1671d76e1bba4faf2588e: start","job_status":"start","queue_duration_s":0.031007,"scheduling_latency_s":0.031021}1349gitlab # [ 143.893675] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.387Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1350gitlab # [ 143.903380] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.396Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"1ca1671d76e1bba4faf2588e","created_at":"2026-11-07T12:11:18.304Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72cc973876277c77c722951a087b008b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.344Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-1ca1671d76e1bba4faf2588e: done: 0.021204 sec","job_status":"done","queue_duration_s":0.031007,"scheduling_latency_s":0.031021,"redis_calls":10,"redis_duration_s":0.003517,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001015,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001924,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000578,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007398,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000823289,"duration_s":0.021204,"completed_at":"2026-11-07T12:11:18.396Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 143.950121] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.403Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"4c5b74d7f72f9b41b03ef86f","created_at":"2026-11-07T12:11:18.349Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0db5c5629dc786989bce172af03cd17b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.354Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-4c5b74d7f72f9b41b03ef86f: start","job_status":"start","queue_duration_s":0.048846,"scheduling_latency_s":0.04886}1352gitlab # [ 143.998957] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.492Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"4c5b74d7f72f9b41b03ef86f","created_at":"2026-11-07T12:11:18.349Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0db5c5629dc786989bce172af03cd17b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.354Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-4c5b74d7f72f9b41b03ef86f: done: 0.089075 sec","job_status":"done","queue_duration_s":0.048846,"scheduling_latency_s":0.04886,"redis_calls":12,"redis_duration_s":0.004265,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000396,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002117,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001752,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00036094,"exclusive_lock_hold_duration_s":0.05142553,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.089075,"completed_at":"2026-11-07T12:11:18.492Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04601,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 144.041758] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.535Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"935503d3c66c4e6c772035e5","created_at":"2026-11-07T12:11:18.365Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8048be07775837d17ee64c0cb981c07","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.382Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-935503d3c66c4e6c772035e5: start","job_status":"start","queue_duration_s":0.152867,"scheduling_latency_s":0.152893}1354gitlab # [ 144.180805] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.673Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"935503d3c66c4e6c772035e5","created_at":"2026-11-07T12:11:18.365Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8048be07775837d17ee64c0cb981c07","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.382Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-935503d3c66c4e6c772035e5: done: 0.138432 sec","job_status":"done","queue_duration_s":0.152867,"scheduling_latency_s":0.152893,"redis_calls":14,"redis_duration_s":0.02353,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004815,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005486,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.013229,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.010007138,"exclusive_lock_hold_duration_s":0.061013061,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.138432,"completed_at":"2026-11-07T12:11:18.673Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.048084,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 144.241937] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.692Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"b38dd93d0f518b12dcfd7932","created_at":"2026-11-07T12:11:18.386Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.390Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-b38dd93d0f518b12dcfd7932: start","job_status":"start","queue_duration_s":0.30125,"scheduling_latency_s":0.301288}1356gitlab # [ 144.298075] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.791Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"b38dd93d0f518b12dcfd7932","created_at":"2026-11-07T12:11:18.386Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.390Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-b38dd93d0f518b12dcfd7932: done: 0.099097 sec","job_status":"done","queue_duration_s":0.30125,"scheduling_latency_s":0.301288,"redis_calls":28,"redis_duration_s":0.009836000000000001,"redis_read_bytes":36,"redis_write_bytes":10603,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001258,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000582,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8315,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.006195,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001801,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000306184,"duration_s":0.099097,"completed_at":"2026-11-07T12:11:18.791Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 144.328113] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.792Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"16fe3349bbaa775b61816a09","created_at":"2026-11-07T12:11:18.402Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5c62fd2c93d53f9d2c553ed56270728","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.408Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-16fe3349bbaa775b61816a09: start","job_status":"start","queue_duration_s":0.383842,"scheduling_latency_s":0.383856}1358gitlab # [ 144.365354] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.858Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1359gitlab # [ 144.380637] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.873Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"16fe3349bbaa775b61816a09","created_at":"2026-11-07T12:11:18.402Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5c62fd2c93d53f9d2c553ed56270728","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.408Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-16fe3349bbaa775b61816a09: done: 0.080779 sec","job_status":"done","queue_duration_s":0.383842,"scheduling_latency_s":0.383856,"redis_calls":10,"redis_duration_s":0.003163,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000603,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001908,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000652,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.055,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000591695,"duration_s":0.080779,"completed_at":"2026-11-07T12:11:18.873Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.054517,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 144.421604] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.914Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bdde4e752d951a17cf131408","created_at":"2026-11-07T12:11:18.413Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4903664d01640098b2a2141640300a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.420Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bdde4e752d951a17cf131408: start","job_status":"start","queue_duration_s":0.493522,"scheduling_latency_s":0.493562}1361gitlab # [ 144.467208] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.959Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bdde4e752d951a17cf131408","created_at":"2026-11-07T12:11:18.413Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4903664d01640098b2a2141640300a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.420Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bdde4e752d951a17cf131408: done: 0.045157 sec","job_status":"done","queue_duration_s":0.493522,"scheduling_latency_s":0.493562,"redis_calls":12,"redis_duration_s":0.002659,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000905,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0013,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000454,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000477993,"duration_s":0.045157,"completed_at":"2026-11-07T12:11:18.959Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000962,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 144.505934] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:18.999Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"0d0a2db3e175bc5d4fff2baa","created_at":"2026-11-07T12:11:18.424Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d370e6376adb42c19af23cb0b8ad1df5","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.428Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-0d0a2db3e175bc5d4fff2baa: start","job_status":"start","queue_duration_s":0.570718,"scheduling_latency_s":0.570751}1363gitlab # [ 144.869392] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.361Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"0d0a2db3e175bc5d4fff2baa","created_at":"2026-11-07T12:11:18.424Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d370e6376adb42c19af23cb0b8ad1df5","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.428Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-0d0a2db3e175bc5d4fff2baa: done: 0.362921 sec","job_status":"done","queue_duration_s":0.570718,"scheduling_latency_s":0.570751,"redis_calls":565,"redis_duration_s":0.11621400000000001,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000717,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001744,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.113753,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.266738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000436089,"duration_s":0.362921,"completed_at":"2026-11-07T12:11:19.361Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000571,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 144.934353] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.363Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"89da97296dda211525dea31d","created_at":"2026-11-07T12:11:18.431Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1f68951396551adfa2775da0c075ced","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.447Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-89da97296dda211525dea31d: start","job_status":"start","queue_duration_s":0.915968,"scheduling_latency_s":0.915982}1365gitlab # [ 144.976622] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.469Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"89da97296dda211525dea31d","created_at":"2026-11-07T12:11:18.431Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1f68951396551adfa2775da0c075ced","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.447Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-89da97296dda211525dea31d: done: 0.105757 sec","job_status":"done","queue_duration_s":0.915968,"scheduling_latency_s":0.915982,"redis_calls":16,"redis_duration_s":0.005028,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002638,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001809,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000581,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000498666,"duration_s":0.105757,"completed_at":"2026-11-07T12:11:19.469Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.071284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 145.014160] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.471Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"488c0fcd711a14263e782f85","created_at":"2026-11-07T12:11:18.466Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"046871b284cda6ee194e01986d5e73a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.471Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-488c0fcd711a14263e782f85: start","job_status":"start","queue_duration_s":0.999743,"scheduling_latency_s":0.99977}1367gitlab # [ 145.026237] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.507Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"488c0fcd711a14263e782f85","created_at":"2026-11-07T12:11:18.466Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"046871b284cda6ee194e01986d5e73a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.471Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-488c0fcd711a14263e782f85: done: 0.03602 sec","job_status":"done","queue_duration_s":0.999743,"scheduling_latency_s":0.99977,"redis_calls":19,"redis_duration_s":0.004401,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000962,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000226,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00252,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000693,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000364292,"duration_s":0.03602,"completed_at":"2026-11-07T12:11:19.507Z","load_balancing_strategy":"primary","db_duration_s":0.009462,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 145.047844] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.508Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e8110c5de255252ce940876b","created_at":"2026-11-07T12:11:18.478Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45f7368dddd29ffe10bf1aab507c4ccd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-11-07T12:11:18.482Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e8110c5de255252ce940876b: start","job_status":"start","queue_duration_s":1.025888,"scheduling_latency_s":1.025901}1369gitlab # [ 145.048888] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.528Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e8110c5de255252ce940876b","created_at":"2026-11-07T12:11:18.478Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45f7368dddd29ffe10bf1aab507c4ccd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-11-07T12:11:18.482Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e8110c5de255252ce940876b: done: 0.0194 sec","job_status":"done","queue_duration_s":1.025888,"scheduling_latency_s":1.025901,"redis_calls":10,"redis_duration_s":0.0012690000000000002,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000756,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000188851,"duration_s":0.0194,"completed_at":"2026-11-07T12:11:19.528Z","load_balancing_strategy":"primary","db_duration_s":0.002142,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 145.099773] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.529Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"827b96d0346aac7016341afb","created_at":"2026-11-07T12:11:18.490Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"07df18e1620bb12a2d494e029522c39e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-11-07T12:11:18.549Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-827b96d0346aac7016341afb: start","job_status":"start","queue_duration_s":0.97956,"scheduling_latency_s":0.979573}1371gitlab # [ 145.100748] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.537Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1372gitlab # [ 145.101781] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.542Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"827b96d0346aac7016341afb","created_at":"2026-11-07T12:11:18.490Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"07df18e1620bb12a2d494e029522c39e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-11-07T12:11:18.549Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-827b96d0346aac7016341afb: done: 0.013345 sec","job_status":"done","queue_duration_s":0.97956,"scheduling_latency_s":0.979573,"redis_calls":10,"redis_duration_s":0.0021809999999999998,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000442,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001272,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000467,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000270146,"duration_s":0.013345,"completed_at":"2026-11-07T12:11:19.542Z","load_balancing_strategy":"primary","db_duration_s":0.000678,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 145.169289] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.662Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"dc48e48f8ad776e38798f828","created_at":"2026-11-07T12:11:18.560Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a4bfa6b0dd34cc87eefc829ec512722","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.576Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-dc48e48f8ad776e38798f828: start","job_status":"start","queue_duration_s":1.086113,"scheduling_latency_s":1.08614}1374gitlab # [ 145.192607] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.685Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"dc48e48f8ad776e38798f828","created_at":"2026-11-07T12:11:18.560Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a4bfa6b0dd34cc87eefc829ec512722","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.576Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-dc48e48f8ad776e38798f828: done: 0.023419 sec","job_status":"done","queue_duration_s":1.086113,"scheduling_latency_s":1.08614,"redis_calls":13,"redis_duration_s":0.002487,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000394,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001279,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000814,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0063840519999999994,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.023419,"completed_at":"2026-11-07T12:11:19.685Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002515,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1375gitlab # [ 145.233477] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.726Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"6adb1613815408d29a953ed5","created_at":"2026-11-07T12:11:18.592Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"149725cc5e034852067fe1e272e02a22","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.601Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-6adb1613815408d29a953ed5: start","job_status":"start","queue_duration_s":1.125467,"scheduling_latency_s":1.125488}1376gitlab # [ 145.250927] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.744Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"6adb1613815408d29a953ed5","created_at":"2026-11-07T12:11:18.592Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"149725cc5e034852067fe1e272e02a22","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.601Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-6adb1613815408d29a953ed5: done: 0.017376 sec","job_status":"done","queue_duration_s":1.125467,"scheduling_latency_s":1.125488,"redis_calls":12,"redis_duration_s":0.002655,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000449,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001274,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00043581,"exclusive_lock_hold_duration_s":0.00259195,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.017376,"completed_at":"2026-11-07T12:11:19.744Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001785,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 145.291310] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.784Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"2733ebe8f05efc07d92dd29c","created_at":"2026-11-07T12:11:18.608Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1dc522c07689d9f816b21baec38e6716","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.616Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-2733ebe8f05efc07d92dd29c: start","job_status":"start","queue_duration_s":1.167868,"scheduling_latency_s":1.167897}1378gitlab # [ 145.337605] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.830Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"2733ebe8f05efc07d92dd29c","created_at":"2026-11-07T12:11:18.608Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1dc522c07689d9f816b21baec38e6716","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.616Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-2733ebe8f05efc07d92dd29c: done: 0.046084 sec","job_status":"done","queue_duration_s":1.167868,"scheduling_latency_s":1.167897,"redis_calls":10,"redis_duration_s":0.003412,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000715,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00197,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000727,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018293,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000498108,"duration_s":0.046084,"completed_at":"2026-11-07T12:11:19.830Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000795,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 145.379913] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.872Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"cfac73a557699c0ace261ddc","created_at":"2026-11-07T12:11:18.644Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44c2d670a7971734f32953ba088ba7c4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.654Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-cfac73a557699c0ace261ddc: start","job_status":"start","queue_duration_s":1.218758,"scheduling_latency_s":1.218807}1380gitlab # [ 145.432797] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.925Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"cfac73a557699c0ace261ddc","created_at":"2026-11-07T12:11:18.644Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44c2d670a7971734f32953ba088ba7c4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.654Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-cfac73a557699c0ace261ddc: done: 0.052518 sec","job_status":"done","queue_duration_s":1.218758,"scheduling_latency_s":1.218807,"redis_calls":10,"redis_duration_s":0.0036160000000000003,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000795,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002102,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000719,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000601194,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.052518,"completed_at":"2026-11-07T12:11:19.925Z","load_balancing_strategy":"primary","db_duration_s":0.017898,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 145.474598] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:19.967Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"5d9ae09a9f179c9e15685103","created_at":"2026-11-07T12:11:18.666Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81d1219a8b7eeeeddf38461b1374ec74","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.676Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-5d9ae09a9f179c9e15685103: start","job_status":"start","queue_duration_s":1.290571,"scheduling_latency_s":1.290614}1382gitlab # [ 145.657539] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.150Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"5d9ae09a9f179c9e15685103","created_at":"2026-11-07T12:11:18.666Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81d1219a8b7eeeeddf38461b1374ec74","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.676Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-5d9ae09a9f179c9e15685103: done: 0.18306 sec","job_status":"done","queue_duration_s":1.290571,"scheduling_latency_s":1.290614,"redis_calls":12,"redis_duration_s":0.003568,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00063,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001557,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001381,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.03,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.134712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000830273,"exclusive_lock_hold_duration_s":0.156402559,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.18306,"completed_at":"2026-11-07T12:11:20.150Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.048484,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 145.746522] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8acc82febf2a44fdf67ee619","created_at":"2026-11-07T12:11:18.691Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76701db9e6025a0a0090b81441f25096","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.696Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8acc82febf2a44fdf67ee619: start","job_status":"start","queue_duration_s":1.542537,"scheduling_latency_s":1.542578}1384gitlab # [ 145.777703] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.270Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1385gitlab # [ 145.792792] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.285Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8acc82febf2a44fdf67ee619","created_at":"2026-11-07T12:11:18.691Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76701db9e6025a0a0090b81441f25096","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.696Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8acc82febf2a44fdf67ee619: done: 0.046001 sec","job_status":"done","queue_duration_s":1.542537,"scheduling_latency_s":1.542578,"redis_calls":10,"redis_duration_s":0.004824999999999999,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000469,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003938,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000410108,"duration_s":0.046001,"completed_at":"2026-11-07T12:11:20.285Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001007,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 145.836548] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"6756aac355a6a8d4b030ec68","created_at":"2026-11-07T12:11:18.699Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1a25bae7f1a79fcf7820b7eaed97c4f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.703Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-6756aac355a6a8d4b030ec68: start","job_status":"start","queue_duration_s":1.625846,"scheduling_latency_s":1.625897}1387gitlab # [ 145.878428] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.370Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"6756aac355a6a8d4b030ec68","created_at":"2026-11-07T12:11:18.699Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1a25bae7f1a79fcf7820b7eaed97c4f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.703Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-6756aac355a6a8d4b030ec68: done: 0.041032 sec","job_status":"done","queue_duration_s":1.625846,"scheduling_latency_s":1.625897,"redis_calls":10,"redis_duration_s":0.003415,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000665,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001889,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000861,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000458159,"duration_s":0.041032,"completed_at":"2026-11-07T12:11:20.370Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 145.918942] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.411Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"18798f12ec800b128538182a","created_at":"2026-11-07T12:11:18.707Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.721Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-18798f12ec800b128538182a: start","job_status":"start","queue_duration_s":1.690646,"scheduling_latency_s":1.690698}1389gitlab # [ 146.034488] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.527Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"18798f12ec800b128538182a","created_at":"2026-11-07T12:11:18.707Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-e909f68c7fe7494a","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.721Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-18798f12ec800b128538182a: done: 0.115906 sec","job_status":"done","queue_duration_s":1.690646,"scheduling_latency_s":1.690698,"redis_calls":71,"redis_duration_s":0.021533999999999998,"redis_read_bytes":120,"redis_write_bytes":42574,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.003564,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001016,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.016019,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.087506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000341943,"duration_s":0.115906,"completed_at":"2026-11-07T12:11:20.527Z","load_balancing_strategy":"primary","db_duration_s":0.003744,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 146.115308] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7a291a81b5b84159333929e2","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7a291a81b5b84159333929e2: start","job_status":"start","queue_duration_s":1.823826,"scheduling_latency_s":1.823855}1391gitlab # [ 146.148462] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7a291a81b5b84159333929e2","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7a291a81b5b84159333929e2: done: 0.03333 sec","job_status":"done","queue_duration_s":1.823826,"scheduling_latency_s":1.823855,"redis_calls":16,"redis_duration_s":0.003647,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000515,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002067,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000362057,"duration_s":0.03333,"completed_at":"2026-11-07T12:11:20.641Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01161,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 146.187779] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.681Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"48a5957d550b3e8bc92d664f","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-48a5957d550b3e8bc92d664f: start","job_status":"start","queue_duration_s":1.89649,"scheduling_latency_s":1.896509}1393gitlab # [ 146.201661] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"48a5957d550b3e8bc92d664f","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-48a5957d550b3e8bc92d664f: done: 0.013868 sec","job_status":"done","queue_duration_s":1.89649,"scheduling_latency_s":1.896509,"redis_calls":13,"redis_duration_s":0.002819,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013868,"completed_at":"2026-11-07T12:11:20.694Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001391,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 146.240571] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"6a09717b6ba1d013de306c06","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-6a09717b6ba1d013de306c06: start","job_status":"start","queue_duration_s":1.948792,"scheduling_latency_s":1.948843}1395gitlab # [ 146.269130] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"6a09717b6ba1d013de306c06","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-6a09717b6ba1d013de306c06: done: 0.028695 sec","job_status":"done","queue_duration_s":1.948792,"scheduling_latency_s":1.948843,"redis_calls":13,"redis_duration_s":0.0044210000000000005,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001335,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028695,"completed_at":"2026-11-07T12:11:20.761Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001174,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 146.272711] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"68cbd1b7ae7b5a0948455250","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-68cbd1b7ae7b5a0948455250: start","job_status":"start","queue_duration_s":1.981259,"scheduling_latency_s":1.981294}1397gitlab # [ 146.334828] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"68cbd1b7ae7b5a0948455250","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-68cbd1b7ae7b5a0948455250: done: 0.061387 sec","job_status":"done","queue_duration_s":1.981259,"scheduling_latency_s":1.981294,"redis_calls":13,"redis_duration_s":0.0042769999999999996,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001288,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061387,"completed_at":"2026-11-07T12:11:20.827Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033713,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 146.374347] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7cdda9841c81671a785fb754","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7cdda9841c81671a785fb754: start","job_status":"start","queue_duration_s":2.08264,"scheduling_latency_s":2.08269}1399gitlab # [ 146.404367] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7cdda9841c81671a785fb754","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7cdda9841c81671a785fb754: done: 0.030066 sec","job_status":"done","queue_duration_s":2.08264,"scheduling_latency_s":2.08269,"redis_calls":13,"redis_duration_s":0.0043690000000000005,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001378,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030066,"completed_at":"2026-11-07T12:11:20.897Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001347,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 146.444272] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"28f5c1333cecb20a26f37876","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-28f5c1333cecb20a26f37876: start","job_status":"start","queue_duration_s":2.152228,"scheduling_latency_s":2.152272}1401gitlab # [ 146.472803] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"28f5c1333cecb20a26f37876","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-28f5c1333cecb20a26f37876: done: 0.028718 sec","job_status":"done","queue_duration_s":2.152228,"scheduling_latency_s":2.152272,"redis_calls":13,"redis_duration_s":0.004358,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003044,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028718,"completed_at":"2026-11-07T12:11:20.965Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00095,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 146.476426] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4f3fad2e6a6d4b72e486eb91","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4f3fad2e6a6d4b72e486eb91: start","job_status":"start","queue_duration_s":2.184926,"scheduling_latency_s":2.184961}1403gitlab # [ 146.505140] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:20.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4f3fad2e6a6d4b72e486eb91","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4f3fad2e6a6d4b72e486eb91: done: 0.028252 sec","job_status":"done","queue_duration_s":2.184926,"scheduling_latency_s":2.184961,"redis_calls":13,"redis_duration_s":0.00387,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001245,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002625,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028252,"completed_at":"2026-11-07T12:11:20.997Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001189,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 146.549268] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"3a8f646377a7c32d246b2ade","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-3a8f646377a7c32d246b2ade: start","job_status":"start","queue_duration_s":2.219332,"scheduling_latency_s":2.219359}1405gitlab # [ 146.550248] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"3a8f646377a7c32d246b2ade","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-3a8f646377a7c32d246b2ade: done: 0.018988 sec","job_status":"done","queue_duration_s":2.219332,"scheduling_latency_s":2.219359,"redis_calls":13,"redis_duration_s":0.003434,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001084,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00235,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018988,"completed_at":"2026-11-07T12:11:21.022Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000879,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 146.597986] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4894a8005dd979945311745b","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4894a8005dd979945311745b: start","job_status":"start","queue_duration_s":2.239561,"scheduling_latency_s":2.239575}1407gitlab # [ 146.598984] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4894a8005dd979945311745b","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4894a8005dd979945311745b: done: 0.011369 sec","job_status":"done","queue_duration_s":2.239561,"scheduling_latency_s":2.239575,"redis_calls":13,"redis_duration_s":0.002553,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000788,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001765,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011369,"completed_at":"2026-11-07T12:11:21.035Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000724,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 146.643461] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b02035a7ea4e7f4b414f66f0","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b02035a7ea4e7f4b414f66f0: start","job_status":"start","queue_duration_s":2.25198,"scheduling_latency_s":2.251993}1409gitlab # [ 146.644769] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b02035a7ea4e7f4b414f66f0","created_at":"2026-11-07T12:11:18.758Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-940a918771d84cc5","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"d1c62d227ea3403ba8170577b4b8466b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:18.784Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b02035a7ea4e7f4b414f66f0: done: 0.018693 sec","job_status":"done","queue_duration_s":2.25198,"scheduling_latency_s":2.251993,"redis_calls":13,"redis_duration_s":0.0073100000000000005,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006523,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018693,"completed_at":"2026-11-07T12:11:21.055Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003179,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 146.685805] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.056Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d7e1536075d7a859ffd473c4","created_at":"2026-11-07T12:11:19.494Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-9cbfae2f3daa4e2d","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"046871b284cda6ee194e01986d5e73a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:19.502Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d7e1536075d7a859ffd473c4: start","job_status":"start","queue_duration_s":1.553618,"scheduling_latency_s":1.553632}1411gitlab # [ 146.686729] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.068Z","message":"No existing merge request to be cleaned up."}1412gitlab # [ 146.687873] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.077Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d7e1536075d7a859ffd473c4","created_at":"2026-11-07T12:11:19.494Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-9cbfae2f3daa4e2d","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"046871b284cda6ee194e01986d5e73a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:19.502Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d7e1536075d7a859ffd473c4: done: 0.021064 sec","job_status":"done","queue_duration_s":1.553618,"scheduling_latency_s":1.553632,"redis_calls":13,"redis_duration_s":0.002825,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000461,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001074,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00129,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002816,"duration_s":0.021064,"completed_at":"2026-11-07T12:11:21.077Z","load_balancing_strategy":"primary","db_duration_s":0.003867,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 146.748267] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.078Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"071fe30fff66633e949d5e88","created_at":"2026-11-07T12:11:19.494Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-9cbfae2f3daa4e2d","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"046871b284cda6ee194e01986d5e73a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:19.502Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-071fe30fff66633e949d5e88: start","job_status":"start","queue_duration_s":1.575846,"scheduling_latency_s":1.57586}1414gitlab # [ 146.748943] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.086Z","message":"No existing merge request to be cleaned up."}1415gitlab # [ 146.751322] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.091Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"071fe30fff66633e949d5e88","created_at":"2026-11-07T12:11:19.494Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-9cbfae2f3daa4e2d","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"046871b284cda6ee194e01986d5e73a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:19.502Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-071fe30fff66633e949d5e88: done: 0.012853 sec","job_status":"done","queue_duration_s":1.575846,"scheduling_latency_s":1.57586,"redis_calls":10,"redis_duration_s":0.002179,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001309,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012853,"completed_at":"2026-11-07T12:11:21.091Z","load_balancing_strategy":"primary","db_duration_s":0.001698,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 146.799410] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.096Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"465c95ef1068ff45e9c5efcb","created_at":"2026-11-07T12:11:19.494Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-9cbfae2f3daa4e2d","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"046871b284cda6ee194e01986d5e73a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:19.502Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-465c95ef1068ff45e9c5efcb: start","job_status":"start","queue_duration_s":1.594062,"scheduling_latency_s":1.594076}1417gitlab # [ 146.800316] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.104Z","message":"No existing merge request to be cleaned up."}1418gitlab # [ 146.801428] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.109Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"465c95ef1068ff45e9c5efcb","created_at":"2026-11-07T12:11:19.494Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-9cbfae2f3daa4e2d","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"046871b284cda6ee194e01986d5e73a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:19.502Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-465c95ef1068ff45e9c5efcb: done: 0.012803 sec","job_status":"done","queue_duration_s":1.594062,"scheduling_latency_s":1.594076,"redis_calls":10,"redis_duration_s":0.002162,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000872,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00129,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007628,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012803,"completed_at":"2026-11-07T12:11:21.109Z","load_balancing_strategy":"primary","db_duration_s":0.001726,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 146.844377] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.110Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"59ae19fc2789c74ca4cee65c","created_at":"2026-11-07T12:11:19.494Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-9cbfae2f3daa4e2d","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"046871b284cda6ee194e01986d5e73a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:19.502Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-59ae19fc2789c74ca4cee65c: start","job_status":"start","queue_duration_s":1.608104,"scheduling_latency_s":1.608117}1420gitlab # [ 146.845136] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.118Z","message":"No existing merge request to be cleaned up."}1421gitlab # [ 146.846270] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.123Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"59ae19fc2789c74ca4cee65c","created_at":"2026-11-07T12:11:19.494Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-9cbfae2f3daa4e2d","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"046871b284cda6ee194e01986d5e73a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:19.502Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-59ae19fc2789c74ca4cee65c: done: 0.012519 sec","job_status":"done","queue_duration_s":1.608104,"scheduling_latency_s":1.608117,"redis_calls":10,"redis_duration_s":0.002071,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001235,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012519,"completed_at":"2026-11-07T12:11:21.123Z","load_balancing_strategy":"primary","db_duration_s":0.001657,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 146.898858] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d3ae3c13e3a1126f66be391","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d3ae3c13e3a1126f66be391: start","job_status":"start","queue_duration_s":0.604659,"scheduling_latency_s":0.604672}1423gitlab # [ 146.899900] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d3ae3c13e3a1126f66be391","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d3ae3c13e3a1126f66be391: done: 0.018461 sec","job_status":"done","queue_duration_s":0.604659,"scheduling_latency_s":0.604672,"redis_calls":16,"redis_duration_s":0.00585,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00044,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003427,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001983,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000269028,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018461,"completed_at":"2026-11-07T12:11:21.143Z","load_balancing_strategy":"primary","db_duration_s":0.000461,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 146.950868] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18a0de090cf26d4622e08f9d","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18a0de090cf26d4622e08f9d: start","job_status":"start","queue_duration_s":0.62432,"scheduling_latency_s":0.624333}1425gitlab # [ 146.951762] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18a0de090cf26d4622e08f9d","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18a0de090cf26d4622e08f9d: done: 0.010977 sec","job_status":"done","queue_duration_s":0.62432,"scheduling_latency_s":0.624333,"redis_calls":13,"redis_duration_s":0.002539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010977,"completed_at":"2026-11-07T12:11:21.155Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 146.959075] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96adec8dd94a6bc928f50cda","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96adec8dd94a6bc928f50cda: start","job_status":"start","queue_duration_s":0.636437,"scheduling_latency_s":0.63645}1427gitlab # [ 146.970615] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96adec8dd94a6bc928f50cda","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96adec8dd94a6bc928f50cda: done: 0.010838 sec","job_status":"done","queue_duration_s":0.636437,"scheduling_latency_s":0.63645,"redis_calls":13,"redis_duration_s":0.002442,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001685,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010838,"completed_at":"2026-11-07T12:11:21.167Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 147.021785] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01e9de60c0408bad77d1bd20","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01e9de60c0408bad77d1bd20: start","job_status":"start","queue_duration_s":0.648689,"scheduling_latency_s":0.648703}1429gitlab # [ 147.022718] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01e9de60c0408bad77d1bd20","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01e9de60c0408bad77d1bd20: done: 0.057221 sec","job_status":"done","queue_duration_s":0.648689,"scheduling_latency_s":0.648703,"redis_calls":13,"redis_duration_s":0.005296,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003627,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001669,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.057221,"completed_at":"2026-11-07T12:11:21.226Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 147.055191] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25579eb245ff09cf58b2af59","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25579eb245ff09cf58b2af59: start","job_status":"start","queue_duration_s":0.707474,"scheduling_latency_s":0.707491}1431gitlab # [ 147.101208] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25579eb245ff09cf58b2af59","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25579eb245ff09cf58b2af59: done: 0.011402 sec","job_status":"done","queue_duration_s":0.707474,"scheduling_latency_s":0.707491,"redis_calls":13,"redis_duration_s":0.002536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000828,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001708,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011402,"completed_at":"2026-11-07T12:11:21.239Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 147.102628] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18b78ba8a34be1de3dd37130","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18b78ba8a34be1de3dd37130: start","job_status":"start","queue_duration_s":0.719945,"scheduling_latency_s":0.719966}1433gitlab # [ 147.114596] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18b78ba8a34be1de3dd37130","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18b78ba8a34be1de3dd37130: done: 0.016759 sec","job_status":"done","queue_duration_s":0.719945,"scheduling_latency_s":0.719966,"redis_calls":13,"redis_duration_s":0.008027,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001751,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006276,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016759,"completed_at":"2026-11-07T12:11:21.256Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 147.187244] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"510d5b94b40f8d04e6692864","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-510d5b94b40f8d04e6692864: start","job_status":"start","queue_duration_s":0.737986,"scheduling_latency_s":0.738}1435gitlab # [ 147.187510] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"510d5b94b40f8d04e6692864","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-510d5b94b40f8d04e6692864: done: 0.009772 sec","job_status":"done","queue_duration_s":0.737986,"scheduling_latency_s":0.738,"redis_calls":13,"redis_duration_s":0.002411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000785,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001626,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009772,"completed_at":"2026-11-07T12:11:21.267Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 147.227688] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c9dcc8abd9df7cd6b91cd4c","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c9dcc8abd9df7cd6b91cd4c: start","job_status":"start","queue_duration_s":0.749114,"scheduling_latency_s":0.749126}1437gitlab # [ 147.228458] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c9dcc8abd9df7cd6b91cd4c","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c9dcc8abd9df7cd6b91cd4c: done: 0.009843 sec","job_status":"done","queue_duration_s":0.749114,"scheduling_latency_s":0.749126,"redis_calls":13,"redis_duration_s":0.00244,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000789,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001651,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009843,"completed_at":"2026-11-07T12:11:21.279Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 147.270311] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb317e1bebc3698baffd00c3","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb317e1bebc3698baffd00c3: start","job_status":"start","queue_duration_s":0.760023,"scheduling_latency_s":0.760036}1439gitlab # [ 147.271079] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb317e1bebc3698baffd00c3","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb317e1bebc3698baffd00c3: done: 0.010761 sec","job_status":"done","queue_duration_s":0.760023,"scheduling_latency_s":0.760036,"redis_calls":13,"redis_duration_s":0.0030499999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002234,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010761,"completed_at":"2026-11-07T12:11:21.290Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 147.329064] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c16d69dd853ba129e7f2c88","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c16d69dd853ba129e7f2c88: start","job_status":"start","queue_duration_s":0.771831,"scheduling_latency_s":0.771844}1441gitlab # [ 147.329817] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c16d69dd853ba129e7f2c88","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c16d69dd853ba129e7f2c88: done: 0.012795 sec","job_status":"done","queue_duration_s":0.771831,"scheduling_latency_s":0.771844,"redis_calls":13,"redis_duration_s":0.003373,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002549,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012795,"completed_at":"2026-11-07T12:11:21.304Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 147.341677] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cbb1ef7c34ca51ccabda62a","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cbb1ef7c34ca51ccabda62a: start","job_status":"start","queue_duration_s":0.785996,"scheduling_latency_s":0.786011}1443gitlab # [ 147.388359] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cbb1ef7c34ca51ccabda62a","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cbb1ef7c34ca51ccabda62a: done: 0.010173 sec","job_status":"done","queue_duration_s":0.785996,"scheduling_latency_s":0.786011,"redis_calls":13,"redis_duration_s":0.00233,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000712,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001618,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010173,"completed_at":"2026-11-07T12:11:21.316Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 147.389739] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a393baa6e5ef6515cd6332f","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a393baa6e5ef6515cd6332f: start","job_status":"start","queue_duration_s":0.796844,"scheduling_latency_s":0.796857}1445gitlab # [ 147.433320] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a393baa6e5ef6515cd6332f","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a393baa6e5ef6515cd6332f: done: 0.009781 sec","job_status":"done","queue_duration_s":0.796844,"scheduling_latency_s":0.796857,"redis_calls":13,"redis_duration_s":0.002411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000834,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001577,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009781,"completed_at":"2026-11-07T12:11:21.326Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 147.437677] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4bf85817af8aa1b2ae12aae","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4bf85817af8aa1b2ae12aae: start","job_status":"start","queue_duration_s":0.807636,"scheduling_latency_s":0.807649}1447gitlab # [ 147.449639] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4bf85817af8aa1b2ae12aae","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4bf85817af8aa1b2ae12aae: done: 0.009907 sec","job_status":"done","queue_duration_s":0.807636,"scheduling_latency_s":0.807649,"redis_calls":13,"redis_duration_s":0.002449,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000776,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001673,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009907,"completed_at":"2026-11-07T12:11:21.337Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 147.499675] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f586a6ef2ed1eadb2c40a404","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f586a6ef2ed1eadb2c40a404: start","job_status":"start","queue_duration_s":0.821738,"scheduling_latency_s":0.821752}1449gitlab # [ 147.500627] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f586a6ef2ed1eadb2c40a404","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f586a6ef2ed1eadb2c40a404: done: 0.013962 sec","job_status":"done","queue_duration_s":0.821738,"scheduling_latency_s":0.821752,"redis_calls":13,"redis_duration_s":0.005895,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001777,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013962,"completed_at":"2026-11-07T12:11:21.355Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 147.546152] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c889bae12ac29fc8cddd76dc","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c889bae12ac29fc8cddd76dc: start","job_status":"start","queue_duration_s":0.837095,"scheduling_latency_s":0.837109}1451gitlab # [ 147.546934] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c889bae12ac29fc8cddd76dc","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c889bae12ac29fc8cddd76dc: done: 0.009564 sec","job_status":"done","queue_duration_s":0.837095,"scheduling_latency_s":0.837109,"redis_calls":13,"redis_duration_s":0.0020139999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000649,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001365,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009564,"completed_at":"2026-11-07T12:11:21.366Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 147.589750] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"efa65b48dc328c2f35243ded","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-efa65b48dc328c2f35243ded: start","job_status":"start","queue_duration_s":0.84762,"scheduling_latency_s":0.847634}1453gitlab # [ 147.592028] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"efa65b48dc328c2f35243ded","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-efa65b48dc328c2f35243ded: done: 0.00986 sec","job_status":"done","queue_duration_s":0.84762,"scheduling_latency_s":0.847634,"redis_calls":13,"redis_duration_s":0.002019,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000664,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001355,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00986,"completed_at":"2026-11-07T12:11:21.377Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 147.628932] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.378Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d4da9c8833d64897b9f2935","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d4da9c8833d64897b9f2935: start","job_status":"start","queue_duration_s":0.858498,"scheduling_latency_s":0.858511}1455gitlab # [ 147.671164] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d4da9c8833d64897b9f2935","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d4da9c8833d64897b9f2935: done: 0.0096 sec","job_status":"done","queue_duration_s":0.858498,"scheduling_latency_s":0.858511,"redis_calls":13,"redis_duration_s":0.0020959999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001415,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0096,"completed_at":"2026-11-07T12:11:21.388Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 147.676749] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ab8db1125d9169005d02d69","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ab8db1125d9169005d02d69: start","job_status":"start","queue_duration_s":0.869033,"scheduling_latency_s":0.869046}1457gitlab # [ 147.723071] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ab8db1125d9169005d02d69","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ab8db1125d9169005d02d69: done: 0.017942 sec","job_status":"done","queue_duration_s":0.869033,"scheduling_latency_s":0.869046,"redis_calls":13,"redis_duration_s":0.010303999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008783,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017942,"completed_at":"2026-11-07T12:11:21.407Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 147.724083] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9d2dfc480ab8e874d39e2a2","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9d2dfc480ab8e874d39e2a2: start","job_status":"start","queue_duration_s":0.888238,"scheduling_latency_s":0.888251}1459gitlab # [ 147.735685] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9d2dfc480ab8e874d39e2a2","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9d2dfc480ab8e874d39e2a2: done: 0.009545 sec","job_status":"done","queue_duration_s":0.888238,"scheduling_latency_s":0.888251,"redis_calls":13,"redis_duration_s":0.002026,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000633,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001393,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009545,"completed_at":"2026-11-07T12:11:21.417Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 147.781964] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"140b5df27e33b913bca760b3","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-140b5df27e33b913bca760b3: start","job_status":"start","queue_duration_s":0.89872,"scheduling_latency_s":0.898733}1461gitlab # [ 147.822703] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"140b5df27e33b913bca760b3","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-140b5df27e33b913bca760b3: done: 0.009439 sec","job_status":"done","queue_duration_s":0.89872,"scheduling_latency_s":0.898733,"redis_calls":13,"redis_duration_s":0.002047,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001381,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009439,"completed_at":"2026-11-07T12:11:21.428Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 147.823959] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db02047bf6ad3ddc18cd8e4a","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db02047bf6ad3ddc18cd8e4a: start","job_status":"start","queue_duration_s":0.909068,"scheduling_latency_s":0.909081}1463gitlab # [ 147.865077] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db02047bf6ad3ddc18cd8e4a","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db02047bf6ad3ddc18cd8e4a: done: 0.009563 sec","job_status":"done","queue_duration_s":0.909068,"scheduling_latency_s":0.909081,"redis_calls":13,"redis_duration_s":0.002064,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000663,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001401,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009563,"completed_at":"2026-11-07T12:11:21.438Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 147.867136] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf7e7fe07f337563997f853c","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf7e7fe07f337563997f853c: start","job_status":"start","queue_duration_s":0.919649,"scheduling_latency_s":0.919661}1465gitlab # [ 147.878879] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf7e7fe07f337563997f853c","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf7e7fe07f337563997f853c: done: 0.018107 sec","job_status":"done","queue_duration_s":0.919649,"scheduling_latency_s":0.919661,"redis_calls":13,"redis_duration_s":0.010426000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005438,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018107,"completed_at":"2026-11-07T12:11:21.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 147.950443] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9593e1411a74107508a4981a","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9593e1411a74107508a4981a: start","job_status":"start","queue_duration_s":0.941185,"scheduling_latency_s":0.941228}1467gitlab # [ 147.951183] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9593e1411a74107508a4981a","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9593e1411a74107508a4981a: done: 0.020665 sec","job_status":"done","queue_duration_s":0.941185,"scheduling_latency_s":0.941228,"redis_calls":13,"redis_duration_s":0.003058,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020665,"completed_at":"2026-11-07T12:11:21.481Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 147.963734] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94ec7ed2f5f658ab394d3b67","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94ec7ed2f5f658ab394d3b67: start","job_status":"start","queue_duration_s":0.963342,"scheduling_latency_s":0.963355}1469gitlab # [ 148.011183] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94ec7ed2f5f658ab394d3b67","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94ec7ed2f5f658ab394d3b67: done: 0.009018 sec","job_status":"done","queue_duration_s":0.963342,"scheduling_latency_s":0.963355,"redis_calls":13,"redis_duration_s":0.001892,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001382,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009018,"completed_at":"2026-11-07T12:11:21.492Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 148.012229] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e0e69c35493b28ab87bfc0d","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e0e69c35493b28ab87bfc0d: start","job_status":"start","queue_duration_s":0.97317,"scheduling_latency_s":0.973182}1471gitlab # [ 148.061246] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e0e69c35493b28ab87bfc0d","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e0e69c35493b28ab87bfc0d: done: 0.008676 sec","job_status":"done","queue_duration_s":0.97317,"scheduling_latency_s":0.973182,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000473,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008676,"completed_at":"2026-11-07T12:11:21.502Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 148.062463] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47ba609813a124631dfa60af","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47ba609813a124631dfa60af: start","job_status":"start","queue_duration_s":0.982654,"scheduling_latency_s":0.982667}1473gitlab # [ 148.070741] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47ba609813a124631dfa60af","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47ba609813a124631dfa60af: done: 0.008754 sec","job_status":"done","queue_duration_s":0.982654,"scheduling_latency_s":0.982667,"redis_calls":13,"redis_duration_s":0.001588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001125,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008754,"completed_at":"2026-11-07T12:11:21.511Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 148.115682] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f19e0138ef18e5411b39c95","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f19e0138ef18e5411b39c95: start","job_status":"start","queue_duration_s":0.992506,"scheduling_latency_s":0.992519}1475gitlab # [ 148.157218] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f19e0138ef18e5411b39c95","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f19e0138ef18e5411b39c95: done: 0.01949 sec","job_status":"done","queue_duration_s":0.992506,"scheduling_latency_s":0.992519,"redis_calls":13,"redis_duration_s":0.012058,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00243,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009628,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01949,"completed_at":"2026-11-07T12:11:21.532Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 148.157969] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0853578b000a67191f03b00e","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0853578b000a67191f03b00e: start","job_status":"start","queue_duration_s":1.014606,"scheduling_latency_s":1.01462}1477gitlab # [ 148.202585] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0853578b000a67191f03b00e","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0853578b000a67191f03b00e: done: 0.017214 sec","job_status":"done","queue_duration_s":1.014606,"scheduling_latency_s":1.01462,"redis_calls":13,"redis_duration_s":0.008729,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002266,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006463,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017214,"completed_at":"2026-11-07T12:11:21.552Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 148.203687] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15f1fc17c73b376fe2b89a23","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15f1fc17c73b376fe2b89a23: start","job_status":"start","queue_duration_s":1.034568,"scheduling_latency_s":1.034582}1479gitlab # [ 148.213223] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15f1fc17c73b376fe2b89a23","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15f1fc17c73b376fe2b89a23: done: 0.008732 sec","job_status":"done","queue_duration_s":1.034568,"scheduling_latency_s":1.034582,"redis_calls":13,"redis_duration_s":0.001506,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008732,"completed_at":"2026-11-07T12:11:21.563Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 148.261692] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ca667c20bc630d3c552aa5f","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ca667c20bc630d3c552aa5f: start","job_status":"start","queue_duration_s":1.044089,"scheduling_latency_s":1.044101}1481gitlab # [ 148.262688] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ca667c20bc630d3c552aa5f","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ca667c20bc630d3c552aa5f: done: 0.008402 sec","job_status":"done","queue_duration_s":1.044089,"scheduling_latency_s":1.044101,"redis_calls":13,"redis_duration_s":0.0014030000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008402,"completed_at":"2026-11-07T12:11:21.572Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 148.320766] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ed1a5826bfd5334f5ab9cdf","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ed1a5826bfd5334f5ab9cdf: start","job_status":"start","queue_duration_s":1.053525,"scheduling_latency_s":1.053538}1483gitlab # [ 148.321690] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ed1a5826bfd5334f5ab9cdf","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ed1a5826bfd5334f5ab9cdf: done: 0.00852 sec","job_status":"done","queue_duration_s":1.053525,"scheduling_latency_s":1.053538,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000448,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00852,"completed_at":"2026-11-07T12:11:21.582Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 148.370033] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3309d6129b2f56bd6319a49","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3309d6129b2f56bd6319a49: start","job_status":"start","queue_duration_s":1.062823,"scheduling_latency_s":1.062836}1485gitlab # [ 148.370796] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3309d6129b2f56bd6319a49","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3309d6129b2f56bd6319a49: done: 0.008539 sec","job_status":"done","queue_duration_s":1.062823,"scheduling_latency_s":1.062836,"redis_calls":13,"redis_duration_s":0.001433,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008539,"completed_at":"2026-11-07T12:11:21.591Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 148.429633] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b00e80c6839a9040768480d4","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b00e80c6839a9040768480d4: start","job_status":"start","queue_duration_s":1.07216,"scheduling_latency_s":1.072173}1487gitlab # [ 148.430562] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b00e80c6839a9040768480d4","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b00e80c6839a9040768480d4: done: 0.009519 sec","job_status":"done","queue_duration_s":1.07216,"scheduling_latency_s":1.072173,"redis_calls":13,"redis_duration_s":0.002341,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001828,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009519,"completed_at":"2026-11-07T12:11:21.601Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 148.472124] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e615334d9178519255e99af","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e615334d9178519255e99af: start","job_status":"start","queue_duration_s":1.082508,"scheduling_latency_s":1.082521}1489gitlab # [ 148.472844] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e615334d9178519255e99af","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e615334d9178519255e99af: done: 0.008742 sec","job_status":"done","queue_duration_s":1.082508,"scheduling_latency_s":1.082521,"redis_calls":13,"redis_duration_s":0.001542,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008742,"completed_at":"2026-11-07T12:11:21.611Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 148.483676] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eca959dbd936f7ff28c92e0e","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eca959dbd936f7ff28c92e0e: start","job_status":"start","queue_duration_s":1.092302,"scheduling_latency_s":1.092315}1491gitlab # [ 148.494431] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eca959dbd936f7ff28c92e0e","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eca959dbd936f7ff28c92e0e: done: 0.008625 sec","job_status":"done","queue_duration_s":1.092302,"scheduling_latency_s":1.092315,"redis_calls":13,"redis_duration_s":0.001526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008625,"completed_at":"2026-11-07T12:11:21.621Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 148.535703] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a08980ee46b67b08afbced9e","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a08980ee46b67b08afbced9e: start","job_status":"start","queue_duration_s":1.101736,"scheduling_latency_s":1.101748}1493gitlab # [ 148.539573] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a08980ee46b67b08afbced9e","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a08980ee46b67b08afbced9e: done: 0.008728 sec","job_status":"done","queue_duration_s":1.101736,"scheduling_latency_s":1.101748,"redis_calls":13,"redis_duration_s":0.001492,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008728,"completed_at":"2026-11-07T12:11:21.630Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 148.575243] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"652e412a880be3f358e2d9fe","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-652e412a880be3f358e2d9fe: start","job_status":"start","queue_duration_s":1.11125,"scheduling_latency_s":1.111263}1495gitlab # [ 148.619124] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"652e412a880be3f358e2d9fe","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-652e412a880be3f358e2d9fe: done: 0.008629 sec","job_status":"done","queue_duration_s":1.11125,"scheduling_latency_s":1.111263,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008629,"completed_at":"2026-11-07T12:11:21.640Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 148.620233] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e5e706a07d400a4db742a6d","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e5e706a07d400a4db742a6d: start","job_status":"start","queue_duration_s":1.120918,"scheduling_latency_s":1.120931}1497gitlab # [ 148.631785] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e5e706a07d400a4db742a6d","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e5e706a07d400a4db742a6d: done: 0.008651 sec","job_status":"done","queue_duration_s":1.120918,"scheduling_latency_s":1.120931,"redis_calls":13,"redis_duration_s":0.001461,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008651,"completed_at":"2026-11-07T12:11:21.649Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 148.684195] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1a39ca106824fb179fabe2b","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1a39ca106824fb179fabe2b: start","job_status":"start","queue_duration_s":1.130355,"scheduling_latency_s":1.130367}1499gitlab # [ 148.684875] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:21.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1a39ca106824fb179fabe2b","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1a39ca106824fb179fabe2b: done: 0.008631 sec","job_status":"done","queue_duration_s":1.130355,"scheduling_latency_s":1.130367,"redis_calls":13,"redis_duration_s":0.0015010000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008631,"completed_at":"2026-11-07T12:11:21.659Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 148.743924] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:22.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53994c5bc45a7aeb24154878","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53994c5bc45a7aeb24154878: start","job_status":"start","queue_duration_s":2.46819,"scheduling_latency_s":2.46824}1501gitlab # [ 148.744616] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53994c5bc45a7aeb24154878","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53994c5bc45a7aeb24154878: done: 0.023175 sec","job_status":"done","queue_duration_s":2.46819,"scheduling_latency_s":2.46824,"redis_calls":13,"redis_duration_s":0.002543,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000827,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001716,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023175,"completed_at":"2026-11-07T12:11:23.011Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 148.759588] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"477472118e60368ba6adfd76","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-477472118e60368ba6adfd76: start","job_status":"start","queue_duration_s":2.493084,"scheduling_latency_s":2.493115}1503gitlab # [ 148.770631] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"477472118e60368ba6adfd76","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-477472118e60368ba6adfd76: done: 0.024525 sec","job_status":"done","queue_duration_s":2.493084,"scheduling_latency_s":2.493115,"redis_calls":13,"redis_duration_s":0.006184,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004175,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024525,"completed_at":"2026-11-07T12:11:23.037Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 148.829750] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3eae3e67d518afa800ec4bed","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3eae3e67d518afa800ec4bed: start","job_status":"start","queue_duration_s":2.546211,"scheduling_latency_s":2.54623}1505gitlab # [ 148.830678] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3eae3e67d518afa800ec4bed","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3eae3e67d518afa800ec4bed: done: 0.013716 sec","job_status":"done","queue_duration_s":2.546211,"scheduling_latency_s":2.54623,"redis_calls":13,"redis_duration_s":0.002973,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001191,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001782,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013716,"completed_at":"2026-11-07T12:11:23.080Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 148.851866] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3ac4c28ca1f16dacdd2ddd9","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3ac4c28ca1f16dacdd2ddd9: start","job_status":"start","queue_duration_s":2.562967,"scheduling_latency_s":2.562981}1507gitlab # [ 148.894714] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3ac4c28ca1f16dacdd2ddd9","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3ac4c28ca1f16dacdd2ddd9: done: 0.026841 sec","job_status":"done","queue_duration_s":2.562967,"scheduling_latency_s":2.562981,"redis_calls":13,"redis_duration_s":0.01626,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.013698,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026841,"completed_at":"2026-11-07T12:11:23.110Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 148.897667] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b04fd6b4fd2f79dbdcd18e89","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b04fd6b4fd2f79dbdcd18e89: start","job_status":"start","queue_duration_s":2.591581,"scheduling_latency_s":2.591595}1509gitlab # [ 148.938663] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b04fd6b4fd2f79dbdcd18e89","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b04fd6b4fd2f79dbdcd18e89: done: 0.086935 sec","job_status":"done","queue_duration_s":2.591581,"scheduling_latency_s":2.591595,"redis_calls":13,"redis_duration_s":0.009217,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003322,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.086935,"completed_at":"2026-11-07T12:11:23.198Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 148.942966] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"985040ce18cfccab18a6d208","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-985040ce18cfccab18a6d208: start","job_status":"start","queue_duration_s":2.682036,"scheduling_latency_s":2.682061}1511gitlab # [ 148.954229] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"985040ce18cfccab18a6d208","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-985040ce18cfccab18a6d208: done: 0.047699 sec","job_status":"done","queue_duration_s":2.682036,"scheduling_latency_s":2.682061,"redis_calls":13,"redis_duration_s":0.008378,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002287,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.047699,"completed_at":"2026-11-07T12:11:23.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 149.000874] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dee5c91c19769320e5d307e","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dee5c91c19769320e5d307e: start","job_status":"start","queue_duration_s":2.731643,"scheduling_latency_s":2.731658}1513gitlab # [ 149.001778] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dee5c91c19769320e5d307e","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dee5c91c19769320e5d307e: done: 0.043193 sec","job_status":"done","queue_duration_s":2.731643,"scheduling_latency_s":2.731658,"redis_calls":13,"redis_duration_s":0.034111,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005396,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.028715,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.043193,"completed_at":"2026-11-07T12:11:23.295Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 149.034624] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6c666320004f572658309cf","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6c666320004f572658309cf: start","job_status":"start","queue_duration_s":2.776481,"scheduling_latency_s":2.776497}1515gitlab # [ 149.076811] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6c666320004f572658309cf","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6c666320004f572658309cf: done: 0.014761 sec","job_status":"done","queue_duration_s":2.776481,"scheduling_latency_s":2.776497,"redis_calls":13,"redis_duration_s":0.002303,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014761,"completed_at":"2026-11-07T12:11:23.311Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 149.080617] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6504a8039028741e52da228c","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6504a8039028741e52da228c: start","job_status":"start","queue_duration_s":2.802167,"scheduling_latency_s":2.802182}1517gitlab # [ 149.123760] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6504a8039028741e52da228c","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6504a8039028741e52da228c: done: 0.038509 sec","job_status":"done","queue_duration_s":2.802167,"scheduling_latency_s":2.802182,"redis_calls":13,"redis_duration_s":0.001572,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038509,"completed_at":"2026-11-07T12:11:23.360Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 149.125980] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f2653202cf8f8e07c64e732","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f2653202cf8f8e07c64e732: start","job_status":"start","queue_duration_s":2.841935,"scheduling_latency_s":2.84196}1519gitlab # [ 149.137289] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f2653202cf8f8e07c64e732","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f2653202cf8f8e07c64e732: done: 0.123433 sec","job_status":"done","queue_duration_s":2.841935,"scheduling_latency_s":2.84196,"redis_calls":13,"redis_duration_s":0.004969,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001442,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003527,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.123433,"completed_at":"2026-11-07T12:11:23.485Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 149.181765] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f74996dd10fe61cb665cf51d","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f74996dd10fe61cb665cf51d: start","job_status":"start","queue_duration_s":2.968204,"scheduling_latency_s":2.968229}1521gitlab # [ 149.183183] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:23.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f74996dd10fe61cb665cf51d","created_at":"2026-11-07T12:11:20.448Z","trace_propagation_headers":{"sentry-trace":"579a2804e9e74b10aa48d1c63862a330-fac666b2939f431f","baggage":"sentry-trace_id=579a2804e9e74b10aa48d1c63862a330,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bd24e24ea70ba4515889f3790dffcb7e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:11:20.520Z","job_size_bytes":2,"pid":1615,"sidekiq_tid":"maef","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f74996dd10fe61cb665cf51d: done: 0.015648 sec","job_status":"done","queue_duration_s":2.968204,"scheduling_latency_s":2.968229,"redis_calls":13,"redis_duration_s":0.005888,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001242,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004646,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015648,"completed_at":"2026-11-07T12:11:23.504Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 149.407156] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2988071876 wd_nsec: 29880703651523gitlab # [ 159.371785] setup-gitlab-start[2212]: W, [2026-11-07T12:11:33.864570 #2212] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1524gitlab # [ 179.992950] postgres[2413]: [2413] ERROR: relation "table_without_models" does not exist1525gitlab # [ 179.993864] postgres[2413]: [2413] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1526gitlab # [ 182.839216] runuser[2211]: pam_unix(runuser:session): session closed for user gitlab1527gitlab # [ 182.841232] setup-gitlab-start[2193]: + systemctl restart gitlab-sidekiq.service1528gitlab # [ 182.869474] systemd[1]: Stopping gitlab-sidekiq.service...1529gitlab # [ 182.871699] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:57.364Z","message":"Shutting down"}1530gitlab # [ 182.873055] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:57.365Z","message":"Scheduler exiting..."}1531gitlab # [ 182.874486] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:57.365Z","message":"Terminating quiet threads for default capsule"}1532gitlab # [ 182.876096] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:57.365Z","message":"Scheduler exiting..."}1533gitlab # [ 183.373187] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:57.866Z","message":"Pausing to allow jobs to finish..."}1534gitlab # [ 184.375771] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:58.868Z","message":"Bye!"}1535gitlab # [ 184.396749] sidekiq-cluster[1615]: {"severity":"INFO","time":"2026-11-07T12:11:58.890Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1615,"worker_id":"sidekiq_0","memwd_rss_bytes":936083456,"retry":0}1536gitlab # [ 185.174220] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1537gitlab # [ 185.176631] systemd[1]: Stopped gitlab-sidekiq.service.1538gitlab # [ 185.178502] systemd[1]: gitlab-sidekiq.service: Consumed 55.903s CPU time over 1min 53.062s wall clock time, 957M memory peak, 4.4M read from disk.1539gitlab # [ 185.183078] systemd[1]: Started gitlab-sidekiq.service.1540gitlab # [ 185.185552] setup-gitlab-start[2193]: + mkdir -p /var/lib/secrets1541gitlab # [ 185.190210] setup-gitlab-start[2193]: + echo nixbot-test-token-of-20-chars1542gitlab # [ 185.192071] setup-gitlab-start[2193]: + chmod 644 /var/lib/secrets/gitlab-token1543gitlab # [ 185.193917] setup-gitlab-start[2193]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1544gitlab # [ 185.368723] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:11:59 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 1521545gitlab # [ 185.845701] gitaly[909]: time="2026-11-07T12:12:00.338Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-11-07T12:12:10.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.338" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1546gitlab # [ 185.847178] gitaly[909]: time="2026-11-07T12:12:00.338Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-11-07T12:12:10.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.338" grpc.time_ms=0.232 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1547gitlab # [ 185.999771] gitaly[909]: time="2026-11-07T12:12:00.493Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-11-07T12:12:10.162" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.492" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1548gitlab # [ 186.000651] gitaly[909]: time="2026-11-07T12:12:00.493Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-11-07T12:12:10.162" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.492" grpc.time_ms=0.354 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1549gitlab # [ 186.070491] gitaly[909]: time="2026-11-07T12:12:00.563Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX diskcache=0bd0b998-ffe4-4c91-a364-29114c037be9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-11-07T12:12:10.168" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.499" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1550gitlab # [ 186.090057] gitaly[909]: time="2026-11-07T12:12:00.564Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1571 command.oublock=32 command.real_time_ms=38 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-11-07T12:12:10.168" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.499" grpc.time_ms=64.795 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1551gitlab # [ 186.090710] gitaly[909]: time="2026-11-07T12:12:00.576Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-11-07T12:12:10.245" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.576" pid=909 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1552gitlab # [ 186.091588] gitaly[909]: time="2026-11-07T12:12:00.576Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-11-07T12:12:10.245" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.576" grpc.time_ms=0.537 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1553gitlab # [ 186.098047] gitaly[909]: time="2026-11-07T12:12:00.591Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-11-07T12:12:10.252" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.582" grpc.time_ms=8.789 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1554gitlab # [ 186.142282] gitaly[909]: time="2026-11-07T12:12:00.635Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-11-07T12:12:10.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.635" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1555gitlab # [ 186.152179] gitaly[909]: time="2026-11-07T12:12:00.635Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-11-07T12:12:10.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.635" grpc.time_ms=0.182 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1556gitlab # [ 186.189149] gitaly[909]: time="2026-11-07T12:12:00.682Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX diskcache=5e455661-6d35-4663-af09-0b3a6364cd6b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-11-07T12:12:10.007" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.637" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1557gitlab # [ 186.189959] gitaly[909]: time="2026-11-07T12:12:00.682Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1585 command.oublock=32 command.real_time_ms=21 command.spawn_token_fork_ms=10 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-11-07T12:12:10.007" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.637" grpc.time_ms=45.426 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1558gitlab # [ 186.193983] gitaly[909]: time="2026-11-07T12:12:00.687Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-11-07T12:12:10.056" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.687" pid=909 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1559gitlab # [ 186.196133] gitaly[909]: time="2026-11-07T12:12:00.687Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-11-07T12:12:10.056" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.687" grpc.time_ms=0.307 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1560gitlab # [ 186.201542] gitaly[909]: time="2026-11-07T12:12:00.695Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-11-07T12:12:10.059" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.689" grpc.time_ms=5.192 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1561gitlab # [ 186.219094] gitaly[909]: time="2026-11-07T12:12:00.712Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-11-07T12:12:10.082" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.712" grpc.time_ms=0.089 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1562gitlab # [ 186.223710] gitaly[909]: time="2026-11-07T12:12:00.717Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-11-07T12:12:10.086" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:00.717" grpc.time_ms=0.128 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1563gitlab # [ 186.622919] gitaly[909]: time="2026-11-07T12:12:01.116Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYREG0C870CW3K21MHH3WX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-11-07T12:12:11.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:01.107" grpc.time_ms=8.3 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1564gitlab # [ 186.879331] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:01 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 14961565gitlab # [ 186.883688] setup-gitlab-start[2459]: {"id":1,"message":null,"error":null}1566gitlab # [ 188.202673] sidekiq-cluster[2443]: {"severity":"INFO","time":"2026-11-07T12:12:02.678Z","message":"Starting cluster with 1 processes"}1567gitlab # [ 192.049058] gitaly[909]: time="2026-11-07T12:12:06.542Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRMW3TJPH4E2045MCFF6Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-11-07T12:12:16.201" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:06.531" grpc.time_ms=10.238 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1568gitlab # [ 192.116073] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:06 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 2041569gitlab # [ 192.122609] setup-gitlab-start[2193]: + mkdir -p /tmp/test-flake1570gitlab # [ 192.124658] setup-gitlab-start[2193]: + cd /tmp/test-flake1571gitlab # [ 192.125989] setup-gitlab-start[2193]: + git init -b master1572gitlab # [ 192.158348] setup-gitlab-start[2529]: Initialized empty Git repository in /tmp/test-flake/.git/1573gitlab # [ 192.160925] setup-gitlab-start[2193]: + git config user.name test1574gitlab # [ 192.167397] setup-gitlab-start[2193]: + git config user.email test@example.com1575gitlab # [ 192.173927] setup-gitlab-start[2193]: + cat1576gitlab # [ 192.178918] setup-gitlab-start[2193]: + git add flake.nix1577gitlab # [ 192.184884] setup-gitlab-start[2193]: + git commit -m 'initial commit'1578gitlab # [ 192.207936] setup-gitlab-start[2534]: [master (root-commit) 356d7b1] initial commit1579gitlab # [ 192.210578] setup-gitlab-start[2534]: 1 file changed, 10 insertions(+)1580gitlab # [ 192.212834] setup-gitlab-start[2534]: create mode 100644 flake.nix1581gitlab # [ 192.214213] setup-gitlab-start[2193]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1582gitlab # [ 192.218888] setup-gitlab-start[2193]: + git push -u origin master1583gitlab # [ 192.272475] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:06 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 241584gitlab # [ 192.380388] gitaly[909]: time="2026-11-07T12:12:06.873Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRN7KGT6NGGA5X8KZYQP7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:06.864" grpc.time_ms=9.448 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1585gitlab # [ 192.386095] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:06 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1061586gitlab # [ 192.599813] gitaly[909]: time="2026-11-07T12:12:07.092Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-11-07T12:12:17.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:07.083" grpc.time_ms=8.983 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1587gitlab # [ 192.659454] gitaly[909]: time="2026-11-07T12:12:07.152Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-11-07T12:12:37.043" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-11-07T12:12:07.144" grpc.time_ms=8.146 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1588gitlab # [ 192.718547] gitaly[909]: time="2026-11-07T12:12:07.211Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M6TYRNC48F065SK7ZGAYKNVP duration_ms=175ns method=POST pid=909 status=200 url="http://unix/api/v4/internal/allowed"1589gitlab # [ 192.767300] gitaly[909]: time="2026-11-07T12:12:07.260Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M6TYRNC48F065SK7ZGAYKNVP duration_ms=41ns method=POST pid=909 status=200 url="http://unix/api/v4/internal/pre_receive"1590gitlab # [ 192.774133] gitaly[909]: time="2026-11-07T12:12:07.267Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:07.035" grpc.time_ms=231.888 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1591gitlab # [ 192.836107] gitaly[909]: time="2026-11-07T12:12:07.329Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:07.328" grpc.time_ms=0.849 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1592gitlab # [ 192.888143] gitaly[909]: time="2026-11-07T12:12:07.381Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:07.380" grpc.time_ms=0.512 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1593gitlab # [ 192.930593] gitaly[909]: time="2026-11-07T12:12:07.424Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:07.423" grpc.time_ms=0.322 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1594gitlab # [ 193.253842] gitaly[909]: time="2026-11-07T12:12:07.746Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-11-07T12:12:17.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:07.734" grpc.time_ms=10.458 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1595gitlab # [ 193.338631] gitaly[909]: time="2026-11-07T12:12:07.832Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1569 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-11-07T12:12:17.076" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:07.807" grpc.time_ms=24.343 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1596gitlab # [ 193.427481] gitaly[909]: time="2026-11-07T12:12:07.920Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M6TYRNC48F065SK7ZGAYKNVP duration_ms=462ns method=POST pid=909 status=200 url="http://unix/api/v4/internal/post_receive"1597gitlab # [ 193.434278] gitaly[909]: time="2026-11-07T12:12:07.921Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:07.457" grpc.time_ms=463.667 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1598gitlab # [ 193.473317] gitaly[909]: time="2026-11-07T12:12:07.966Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP diskcache=5f863291-e2b4-48c5-977f-4f39a68c1a7e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:06.968" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1599gitlab # [ 193.494619] gitaly[909]: time="2026-11-07T12:12:07.988Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=197 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=901120 command.minflt=14049 command.oublock=32 command.real_time_ms=985 command.spawn_token_fork_ms=0 command.system_time_ms=127 command.user_time_ms=70 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:06.968" grpc.time_ms=1019.545 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1600gitlab # [ 193.513645] gitlab-workhorse[825]: time="2026-11-07T12:12:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521601gitlab # [ 193.514399] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:08 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 10901602gitlab # [ 193.518454] setup-gitlab-start[2538]: To http://gitlab/root/test-flake.git1603gitlab # [ 193.519642] setup-gitlab-start[2538]: * [new branch] master -> master1604gitlab # [ 193.522648] setup-gitlab-start[2538]: branch 'master' set up to track 'origin/master'.1605gitlab # [ 193.526832] systemd[1]: Finished setup-gitlab.service.1606gitlab # [ 193.532448] systemd[1]: Starting nixbot CI service...1607gitlab: (finished: waiting for unit setup-gitlab.service, in 195.16 seconds)1608gitlab: waiting for unit nixbot.service1609gitlab # [ 194.781371] nixbot[2628]: {"ts": "2026-11-07T12:12:09.274Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1610gitlab # [ 194.812898] nixbot[2628]: {"ts": "2026-11-07T12:12:09.306Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1611gitlab # [ 194.839236] nixbot[2628]: {"ts": "2026-11-07T12:12:09.332Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1612gitlab # [ 194.844733] nixbot[2628]: {"ts": "2026-11-07T12:12:09.338Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1613gitlab # [ 194.849917] nixbot[2628]: {"ts": "2026-11-07T12:12:09.343Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1614gitlab # [ 194.858443] nixbot[2628]: {"ts": "2026-11-07T12:12:09.351Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1615gitlab # [ 194.863610] nixbot[2628]: {"ts": "2026-11-07T12:12:09.356Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1616gitlab # [ 194.868764] nixbot[2628]: {"ts": "2026-11-07T12:12:09.362Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1617gitlab # [ 194.881938] nixbot[2628]: {"ts": "2026-11-07T12:12:09.375Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1618gitlab # [ 194.890293] nixbot[2628]: {"ts": "2026-11-07T12:12:09.383Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1619gitlab # [ 194.902396] nixbot[2628]: {"ts": "2026-11-07T12:12:09.395Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1620gitlab # [ 194.910978] nixbot[2628]: {"ts": "2026-11-07T12:12:09.404Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1621gitlab # [ 194.920238] nixbot[2628]: {"ts": "2026-11-07T12:12:09.413Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1622gitlab # [ 194.928272] nixbot[2628]: {"ts": "2026-11-07T12:12:09.421Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1623gitlab # [ 194.938113] nixbot[2628]: {"ts": "2026-11-07T12:12:09.431Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1624gitlab # [ 194.946066] nixbot[2628]: {"ts": "2026-11-07T12:12:09.439Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1625gitlab # [ 194.953661] nixbot[2628]: {"ts": "2026-11-07T12:12:09.447Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1626gitlab # [ 194.960911] nixbot[2628]: {"ts": "2026-11-07T12:12:09.454Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1627gitlab # [ 194.971989] nixbot[2628]: {"ts": "2026-11-07T12:12:09.465Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1628gitlab # [ 194.978756] nixbot[2628]: {"ts": "2026-11-07T12:12:09.472Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1629gitlab # [ 194.985631] nixbot[2628]: {"ts": "2026-11-07T12:12:09.479Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1630gitlab # [ 194.996524] nixbot[2628]: {"ts": "2026-11-07T12:12:09.489Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1631gitlab # [ 195.002823] nixbot[2628]: {"ts": "2026-11-07T12:12:09.496Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1632gitlab # [ 195.009926] nixbot[2628]: {"ts": "2026-11-07T12:12:09.503Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1633gitlab # [ 195.016276] nixbot[2628]: {"ts": "2026-11-07T12:12:09.509Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1634gitlab # [ 195.024106] nixbot[2628]: {"ts": "2026-11-07T12:12:09.517Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1635gitlab # [ 195.031398] nixbot[2628]: {"ts": "2026-11-07T12:12:09.524Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1636gitlab # [ 195.037677] nixbot[2628]: {"ts": "2026-11-07T12:12:09.531Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1637gitlab # [ 195.043714] nixbot[2628]: {"ts": "2026-11-07T12:12:09.537Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1638gitlab # [ 195.064346] nixbot[2628]: {"ts": "2026-11-07T12:12:09.557Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1639gitlab # [ 195.074883] nixbot[2628]: {"ts": "2026-11-07T12:12:09.568Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1640gitlab # [ 195.082642] nixbot[2628]: {"ts": "2026-11-07T12:12:09.575Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1641gitlab # [ 195.089791] nixbot[2628]: {"ts": "2026-11-07T12:12:09.583Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1642gitlab # [ 195.100095] nixbot[2628]: {"ts": "2026-11-07T12:12:09.593Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1643gitlab # [ 195.107342] nixbot[2628]: {"ts": "2026-11-07T12:12:09.600Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1644gitlab # [ 195.118886] nixbot[2628]: {"ts": "2026-11-07T12:12:09.612Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1645gitlab # [ 195.127265] nixbot[2628]: {"ts": "2026-11-07T12:12:09.620Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1646gitlab # [ 195.136625] nixbot[2628]: {"ts": "2026-11-07T12:12:09.629Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 37, "migration": "effect_when_changed"}1647gitlab # [ 195.145244] nixbot[2628]: {"ts": "2026-11-07T12:12:09.638Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 38, "migration": "commit_statuses"}1648gitlab # [ 195.573261] nixbot[2628]: {"ts": "2026-11-07T12:12:10.066Z", "level": "info", "logger": "uvicorn.error", "msg": "Started server process [2628]", "color_message": "Started server process [\u001b[36m%d\u001b[0m]"}1649gitlab # [ 195.575368] nixbot[2628]: {"ts": "2026-11-07T12:12:10.066Z", "level": "info", "logger": "uvicorn.error", "msg": "Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)"}1650gitlab # [ 195.591145] nixbot[2628]: {"ts": "2026-11-07T12:12:10.084Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:41970 - \"GET /health HTTP/1.1\" 200"}1651gitlab # [ 195.602520] systemd[1]: Started nixbot CI service.1652gitlab # [ 195.604268] systemd[1]: Reached target Multi-User System.1653gitlab # [ 195.608640] systemd[1]: Startup finished in 1.223s (kernel) + 3.486s (initrd) + 3min 10.896s (userspace) = 3min 15.606s.1654gitlab: (finished: waiting for unit nixbot.service, in 1.07 seconds)1655gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1656gitlab # [ 195.666091] nixbot[2628]: {"ts": "2026-11-07T12:12:10.158Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:41978 - \"GET /health HTTP/1.1\" 200"}1657gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1658subtest: project discovered and webhook registered1659gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1660gitlab # [ 195.730627] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 411661gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.06 seconds)1662gitlab # [ 196.357470] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:10 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 7611663gitlab # [ 196.376713] nixbot[2628]: {"ts": "2026-11-07T12:12:10.869Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1664gitlab # [ 196.444487] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 511665gitlab # [ 196.447925] nixbot[2628]: {"ts": "2026-11-07T12:12:10.941Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1666gitlab # [ 196.692454] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 917 "" "python-httpx/0.28.1" 2381667gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1668gitlab # [ 196.806206] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "curl/8.21.0" 411669gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.07 seconds)1670(finished: subtest: project discovered and webhook registered, in 1.14 seconds)1671subtest: push delivers the webhook1672gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1673gitlab # [ 196.827926] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:11 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1261674gitlab # [ 196.875618] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "python-httpx/0.28.1" 391675gitlab # [ 196.926262] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:11 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 917 "" "python-httpx/0.28.1" 441676gitlab # [ 196.980197] gitaly[909]: time="2026-11-07T12:12:11.472Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRSS16XK8XSMK22Q40VYV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-11-07T12:12:41.358" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:11.458" grpc.time_ms=13.427 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1677gitlab # [ 197.006556] gitaly[909]: time="2026-11-07T12:12:11.499Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRSS16XK8XSMK22Q40VYV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:12:41.398" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:11.498" grpc.time_ms=0.65 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1678gitlab # [ 197.028452] gitaly[909]: time="2026-11-07T12:12:11.521Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRSS16XK8XSMK22Q40VYV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-11-07T12:12:21.181" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:11.512" grpc.time_ms=9.593 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1679gitlab # [ 197.071265] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1391680gitlab # [ 197.155371] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 781681gitlab # [ 197.159921] nixbot[2628]: {"ts": "2026-11-07T12:12:11.653Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1682gitlab # [ 197.320723] gitaly[909]: time="2026-11-07T12:12:11.814Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRT30WCX66RM4TAN5T5YP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:11.801" grpc.time_ms=12.049 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1683gitlab # [ 197.351497] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1001684gitlab # [ 197.441396] gitaly[909]: time="2026-11-07T12:12:11.934Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRT6B3EFRG4W506RNZSQ0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:11.924" pid=909 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1685gitlab # [ 197.442587] gitaly[909]: time="2026-11-07T12:12:11.935Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRT6B3EFRG4W506RNZSQ0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:11.924" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1686gitlab # [ 197.443633] gitaly[909]: time="2026-11-07T12:12:11.936Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRT6B3EFRG4W506RNZSQ0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:11.924" grpc.time_ms=11.388 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1687gitlab # [ 197.444764] gitlab-workhorse[825]: time="2026-11-07T12:12:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131688gitlab # [ 197.445858] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 851689gitlab # [ 197.578833] gitaly[909]: time="2026-11-07T12:12:12.072Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTB5JBFSS2P9VXCEA421 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:12.057" pid=909 remote_ip="2001:db8:1::1" request_sha=244c00df0f924eb65103f2107db1c8a483c89979 response_bytes=223 span.kind=server system=grpc1690gitlab # [ 197.601241] gitaly[909]: time="2026-11-07T12:12:12.072Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTB5JBFSS2P9VXCEA421 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:12.057" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1691gitlab # [ 197.603071] gitlab-workhorse[825]: time="2026-11-07T12:12:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231692gitlab # [ 197.604141] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 671693gitlab # [ 197.605291] gitaly[909]: time="2026-11-07T12:12:12.072Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTB5JBFSS2P9VXCEA421 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:12.057" grpc.time_ms=15.306 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1694gitlab # [ 197.709416] gitaly[909]: time="2026-11-07T12:12:12.202Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRTG3B57C6PTXAFWZQF0Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:12.194" grpc.time_ms=8.318 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1695gitlab # [ 197.710798] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 391696gitlab # [ 197.773853] gitaly[909]: time="2026-11-07T12:12:12.267Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTHZ8CB0PX7SNB9RF6EY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:12.256" pid=909 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1697gitlab # [ 197.775787] gitaly[909]: time="2026-11-07T12:12:12.269Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTHZ8CB0PX7SNB9RF6EY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:12.256" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1698gitlab # [ 197.777826] gitaly[909]: time="2026-11-07T12:12:12.271Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTHZ8CB0PX7SNB9RF6EY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:12.256" grpc.time_ms=14.578 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1699gitlab # [ 197.778874] gitlab-workhorse[825]: time="2026-11-07T12:12:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671700gitlab # [ 197.779793] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 481701gitlab # [ 197.904733] gitaly[909]: time="2026-11-07T12:12:12.398Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRTNQY61ZHPQYCXNH1RJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:12.388" grpc.time_ms=9.974 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1702gitlab # [ 197.909044] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 581703gitlab # [ 197.959491] gitaly[909]: time="2026-11-07T12:12:12.452Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTQMCHSJCHZ1E0DXSGVR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:12.437" pid=909 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1704gitlab # [ 197.960472] gitaly[909]: time="2026-11-07T12:12:12.453Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTQMCHSJCHZ1E0DXSGVR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:12.437" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1705gitlab # [ 197.961040] gitaly[909]: time="2026-11-07T12:12:12.453Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTQMCHSJCHZ1E0DXSGVR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:12.437" grpc.time_ms=15.628 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1706gitlab # [ 197.961665] gitlab-workhorse[825]: time="2026-11-07T12:12:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091707gitlab # [ 197.962590] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 491708gitlab # [ 198.069736] gitaly[909]: time="2026-11-07T12:12:12.562Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:12:42.461" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:12.562" grpc.time_ms=0.517 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1709gitlab # [ 198.126841] gitaly[909]: time="2026-11-07T12:12:12.620Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-11-07T12:12:42.509" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:12.610" grpc.time_ms=9.865 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1710gitlab # [ 198.142206] gitaly[909]: time="2026-11-07T12:12:12.635Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:12:22.299" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:12.630" grpc.time_ms=5.324 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1711gitlab # [ 198.152964] gitaly[909]: time="2026-11-07T12:12:12.646Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:12:22.011" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:12.641" grpc.time_ms=4.817 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1712gitlab # [ 198.198119] gitaly[909]: time="2026-11-07T12:12:12.691Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-11-07T12:12:22.061" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:12.691" grpc.time_ms=0.17 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1713gitlab # [ 198.217430] gitaly[909]: time="2026-11-07T12:12:12.710Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-11-07T12:12:22.075" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:12.705" grpc.time_ms=5.203 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1714gitlab # [ 198.267506] gitaly[909]: time="2026-11-07T12:12:12.760Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:12.760" grpc.time_ms=0.319 pid=909 span.kind=server system=grpc1715gitlab # [ 198.292179] gitaly[909]: time="2026-11-07T12:12:12.785Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:12.785" grpc.time_ms=0.295 pid=909 span.kind=server system=grpc1716gitlab # [ 198.310079] gitaly[909]: time="2026-11-07T12:12:12.803Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 diskcache=34367d8b-f21c-44fd-9a83-cd5f6f573ed5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-11-07T12:12:22.093" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:12.724" pid=909 ref=refs/keep-around/356d7b11eb1d1152b4ae5590f7516adaa4143e15 remote_ip="2001:db8:1::1" revision=356d7b11eb1d1152b4ae5590f7516adaa4143e15 span.kind=server system=grpc username=root1717gitlab # [ 198.320390] gitaly[909]: time="2026-11-07T12:12:12.813Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=45 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5411 command.oublock=8 command.real_time_ms=70 command.spawn_token_fork_ms=0 command.system_time_ms=31 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-11-07T12:12:22.093" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:12.724" grpc.time_ms=79.338 pid=909 ref=refs/keep-around/356d7b11eb1d1152b4ae5590f7516adaa4143e15 remote_ip="2001:db8:1::1" revision=356d7b11eb1d1152b4ae5590f7516adaa4143e15 span.kind=server system=grpc username=root1718gitlab # [ 198.334392] gitaly[909]: time="2026-11-07T12:12:12.817Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:12:42.716" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:12.816" grpc.time_ms=0.277 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1719gitlab # [ 198.439315] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/356d7b11eb1d1152b4ae5590f7516adaa4143e15 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 4061720gitlab # [ 198.455075] nixbot[2628]: {"ts": "2026-11-07T12:12:12.947Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-356d7b11eb1d-0"}1721gitlab # [ 198.628667] nixbot[2628]: {"ts": "2026-11-07T12:12:13.122Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-356d7b11eb1d-0", "argv0": "bwrap"}1722gitlab # [ 198.723369] systemd[1]: Started Nix Daemon.1723gitlab # [ 198.794133] nix-daemon[2787]: accepted connection from pid 2782, user nixbot1724gitlab # [ 203.237639] nix-daemon[2787]: accepted connection from pid 2836, user nixbot1725gitlab # [ 203.251364] nix-daemon[2787]: accepted connection from pid 2782, user nixbot1726gitlab # [ 207.976301] nix-daemon[2787]: accepted connection from pid 2782, user nixbot1727gitlab # [ 208.067899] nix-daemon[2787]: accepted connection from pid 2878, user nixbot1728gitlab # [ 208.116575] gitaly[909]: time="2026-11-07T12:12:22.609Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYS4MQ1VGV88XKSN3WC7YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:12:52.507" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:22.608" grpc.time_ms=0.807 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1729gitlab # [ 208.172162] gitaly[909]: time="2026-11-07T12:12:22.665Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M6TYS4MQ1VGV88XKSN3WC7YH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:12:32.023" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:22.653" grpc.time_ms=11.814 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1730gitlab # [ 208.234494] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/356d7b11eb1d1152b4ae5590f7516adaa4143e15 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1751731gitlab # [ 208.291201] gitaly[909]: time="2026-11-07T12:12:22.784Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYS4TJZM3HYV2MQT1V41ZD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:12:52.083" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:22.783" grpc.time_ms=0.727 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1732gitlab # [ 208.432110] gitaly[909]: time="2026-11-07T12:12:22.925Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M6TYS4TJZM3HYV2MQT1V41ZD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:12:32.183" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:22.914" grpc.time_ms=10.979 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1733gitlab # [ 208.539792] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/356d7b11eb1d1152b4ae5590f7516adaa4143e15 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2941734gitlab # [ 212.716324] nix-daemon[2787]: accepted connection from pid 2954, user nixbot1735gitlab # [ 212.780353] gitaly[909]: time="2026-11-07T12:12:27.273Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYS973H3JQFX49QGK1KPDR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:12:57.172" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:27.272" grpc.time_ms=0.685 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1736gitlab # [ 212.834316] gitaly[909]: time="2026-11-07T12:12:27.327Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M6TYS973H3JQFX49QGK1KPDR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:12:37.221" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:27.322" grpc.time_ms=5.368 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1737gitlab # [ 212.885752] sidekiq-cluster[2500]: 2026-11-07T12:12:27.378Z pid=2500 tid=xv0 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2500, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431386624}1738gitlab # [ 212.908491] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/356d7b11eb1d1152b4ae5590f7516adaa4143e15 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1651739gitlab # [ 213.064509] sidekiq-cluster[2500]: W, [2026-11-07T12:12:27.557926 #2500] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1740gitlab # [ 213.101217] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:27.594Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1741gitlab # [ 213.119979] nixbot[2628]: {"ts": "2026-11-07T12:12:27.612Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 1, "sha": "356d7b11eb1d1152b4ae5590f7516adaa4143e15", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []}1742gitlab # [ 213.221745] gitaly[909]: time="2026-11-07T12:12:27.715Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M6TYS9M6YRSDY604NK7C67XA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:27.702" grpc.time_ms=12.497 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1743gitlab # [ 213.248110] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:27 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 601744gitlab # [ 213.318608] gitaly[909]: time="2026-11-07T12:12:27.811Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYS9P4QPYZYTFC89YGHWWG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:27.804" pid=909 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1745gitlab # [ 213.341466] gitaly[909]: time="2026-11-07T12:12:27.834Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYS9P4QPYZYTFC89YGHWWG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:27.804" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1746gitlab # [ 213.366612] gitaly[909]: time="2026-11-07T12:12:27.834Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYS9P4QPYZYTFC89YGHWWG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:27.804" grpc.time_ms=29.612 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1747gitlab # [ 213.379949] gitlab-workhorse[825]: time="2026-11-07T12:12:27Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671748gitlab # [ 213.381771] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:27 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1181749gitlab # [ 213.452932] gitaly[909]: time="2026-11-07T12:12:27.946Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M6TYS9VRBMX5GRQXZ3KD5FBM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:27.940" grpc.time_ms=6.253 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1750gitlab # [ 213.472659] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:27 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 691751gitlab # [ 213.516509] gitaly[909]: time="2026-11-07T12:12:28.009Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYS9Y1WQMS3Q8W2JW7JF27 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:28.003" pid=909 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1752gitlab # [ 213.533727] gitaly[909]: time="2026-11-07T12:12:28.010Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYS9Y1WQMS3Q8W2JW7JF27 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:28.003" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1753gitlab # [ 213.545829] gitaly[909]: time="2026-11-07T12:12:28.039Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYS9Y1WQMS3Q8W2JW7JF27 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:28.003" grpc.time_ms=35.914 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1754gitlab # [ 213.546694] gitlab-workhorse[825]: time="2026-11-07T12:12:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671755gitlab # [ 213.560143] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 701756gitlab # [ 214.763597] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:29.256Z","message":"GitLab reliable fetch activated!"}1757gitlab # [ 214.765382] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:29.256Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1758gitlab # [ 234.218274] postgres[3168]: [3168] ERROR: relation "table_without_models" does not exist1759gitlab # [ 234.220751] postgres[3168]: [3168] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1760gitlab # [ 236.589975] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:51.083Z","message":"Booted Rails 7.2.3.1 application in production environment"}1761gitlab # [ 236.592402] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:51.085Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1762gitlab # [ 236.593054] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:51.086Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1763gitlab # [ 236.593762] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:51.086Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1764gitlab # [ 236.594888] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:51.087Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1765gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 40.40 seconds)1766gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1767gitlab # [ 237.310392] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:51 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 431768gitlab # [ 237.423877] gitaly[909]: time="2026-11-07T12:12:51.916Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT171KRXQ8F9RY9XC1KD5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:51.905" grpc.time_ms=11.268 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1769gitlab # [ 237.425072] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:51 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.55.0" 1081770gitlab # Enumerating objects: 5, done.1771gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1772gitlab # Delta compression using up to 4 threads1773gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1774gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done.1775gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1776gitlab # [ 237.684754] gitaly[909]: time="2026-11-07T12:12:52.178Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=326 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-11-07T12:13:22.066" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-11-07T12:12:52.167" grpc.time_ms=10.567 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1777gitlab # [ 237.726699] gitaly[909]: time="2026-11-07T12:12:52.220Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 duration_ms=114ns method=POST pid=909 status=200 url="http://unix/api/v4/internal/allowed"1778gitlab # [ 237.767127] gitaly[909]: time="2026-11-07T12:12:52.260Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 duration_ms=36ns method=POST pid=909 status=200 url="http://unix/api/v4/internal/pre_receive"1779gitlab # [ 237.776124] gitaly[909]: time="2026-11-07T12:12:52.261Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:52.104" grpc.time_ms=155.991 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1780gitlab # [ 237.808671] gitaly[909]: time="2026-11-07T12:12:52.302Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:52.301" grpc.time_ms=0.685 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1781gitlab # [ 237.854620] gitaly[909]: time="2026-11-07T12:12:52.348Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:52.347" grpc.time_ms=0.265 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1782gitlab # [ 237.883921] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:52.376Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"f0c41f3e5fdbbc595a730113","created_at":"2026-11-07T12:12:00.600Z","trace_propagation_headers":{"sentry-trace":"fc6c5be11aa74a7eba41752e505a4851-6f2f6d402177436e","baggage":"sentry-trace_id=fc6c5be11aa74a7eba41752e505a4851,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYREG0C870CW3K21MHH3WX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:00.622Z","job_size_bytes":2,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-f0c41f3e5fdbbc595a730113: start","job_status":"start","queue_duration_s":51.754688,"scheduling_latency_s":51.754737}1783gitlab # [ 237.894088] gitaly[909]: time="2026-11-07T12:12:52.387Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:52.387" grpc.time_ms=0.336 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1784gitlab # [ 237.943134] gitaly[909]: time="2026-11-07T12:12:52.436Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 duration_ms=30ns method=POST pid=909 status=200 url="http://unix/api/v4/internal/post_receive"1785gitlab # [ 237.946340] gitaly[909]: time="2026-11-07T12:12:52.439Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:52.405" grpc.time_ms=34.542 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1786gitlab # [ 237.964358] gitaly[909]: time="2026-11-07T12:12:52.457Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 diskcache=f4f9365f-f426-4d12-9c5c-b6e46c485294 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:52.027" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1787gitlab # To http://gitlab/root/test-flake.git1788gitlab # [ 237.974825] gitaly[909]: time="2026-11-07T12:12:52.458Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=188 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=880640 command.minflt=13566 command.oublock=32 command.real_time_ms=421 command.spawn_token_fork_ms=1 command.system_time_ms=132 command.user_time_ms=56 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:52.027" grpc.time_ms=430.334 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1789gitlab # 356d7b1..e3f8e82 [ 237.975815] gitlab-workhorse[825]: time="2026-11-07T12:12:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521790gitlab # master -> master[ 237.976702] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:52 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5021791gitlab # 1792gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.79 seconds)1793gitlab: must succeed: git -C /tmp/test-flake rev-parse master1794gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1795gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686'1796gitlab # [ 238.031435] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:52.524Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"f0c41f3e5fdbbc595a730113","created_at":"2026-11-07T12:12:00.600Z","trace_propagation_headers":{"sentry-trace":"fc6c5be11aa74a7eba41752e505a4851-6f2f6d402177436e","baggage":"sentry-trace_id=fc6c5be11aa74a7eba41752e505a4851,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYREG0C870CW3K21MHH3WX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:00.622Z","job_size_bytes":2,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-f0c41f3e5fdbbc595a730113: done: 0.148009 sec","job_status":"done","queue_duration_s":51.754688,"scheduling_latency_s":51.754737,"redis_calls":25,"redis_duration_s":0.0070019999999999995,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.004704,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001125,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001173,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05898962,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.148009,"completed_at":"2026-11-07T12:12:52.524Z","load_balancing_strategy":"primary","db_duration_s":0.030684,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1797gitlab # [ 238.062992] nixbot[2628]: {"ts": "2026-11-07T12:12:52.555Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:49000 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 HTTP/1.1\" 200"}1798gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686', in 0.07 seconds)1799gitlab # [ 238.081714] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:52.574Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"3b27a181e778e1b667ff4677","created_at":"2026-11-07T12:12:00.629Z","trace_propagation_headers":{"sentry-trace":"fc6c5be11aa74a7eba41752e505a4851-6f2f6d402177436e","baggage":"sentry-trace_id=fc6c5be11aa74a7eba41752e505a4851,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYREG0C870CW3K21MHH3WX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:00.632Z","job_size_bytes":2,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-3b27a181e778e1b667ff4677: start","job_status":"start","queue_duration_s":51.942134,"scheduling_latency_s":51.942174}1800gitlab # [ 238.155491] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:52.648Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"3b27a181e778e1b667ff4677","created_at":"2026-11-07T12:12:00.629Z","trace_propagation_headers":{"sentry-trace":"fc6c5be11aa74a7eba41752e505a4851-6f2f6d402177436e","baggage":"sentry-trace_id=fc6c5be11aa74a7eba41752e505a4851,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYREG0C870CW3K21MHH3WX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:00.632Z","job_size_bytes":2,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-3b27a181e778e1b667ff4677: done: 0.073881 sec","job_status":"done","queue_duration_s":51.942134,"scheduling_latency_s":51.942174,"redis_calls":14,"redis_duration_s":0.002856,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000501,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001436,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.052960362000000004,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.073881,"completed_at":"2026-11-07T12:12:52.648Z","load_balancing_strategy":"primary","db_duration_s":0.015609,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1801gitlab # [ 238.158446] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:52.650Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"fe8101451bea8a9d9ac110eb","created_at":"2026-11-07T12:12:01.036Z","trace_propagation_headers":{"sentry-trace":"fc6c5be11aa74a7eba41752e505a4851-6f2f6d402177436e","baggage":"sentry-trace_id=fc6c5be11aa74a7eba41752e505a4851,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYREG0C870CW3K21MHH3WX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:01.041Z","job_size_bytes":5,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-fe8101451bea8a9d9ac110eb: start","job_status":"start","queue_duration_s":51.609045,"scheduling_latency_s":51.609059}1802gitlab # [ 238.308845] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:52.801Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"fe8101451bea8a9d9ac110eb","created_at":"2026-11-07T12:12:01.036Z","trace_propagation_headers":{"sentry-trace":"fc6c5be11aa74a7eba41752e505a4851-6f2f6d402177436e","baggage":"sentry-trace_id=fc6c5be11aa74a7eba41752e505a4851,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYREG0C870CW3K21MHH3WX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:01.041Z","job_size_bytes":5,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-fe8101451bea8a9d9ac110eb: done: 0.151395 sec","job_status":"done","queue_duration_s":51.609045,"scheduling_latency_s":51.609059,"redis_calls":12,"redis_duration_s":0.0033410000000000002,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000644,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002173,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.114462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000426311,"duration_s":0.151395,"completed_at":"2026-11-07T12:12:52.801Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027312,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1803gitlab # [ 238.313334] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:52.804Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"702ef778e907daa2944d9e22","created_at":"2026-11-07T12:12:01.061Z","trace_propagation_headers":{"sentry-trace":"fc6c5be11aa74a7eba41752e505a4851-6f2f6d402177436e","baggage":"sentry-trace_id=fc6c5be11aa74a7eba41752e505a4851,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYREG0C870CW3K21MHH3WX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:01.064Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-702ef778e907daa2944d9e22: start","job_status":"start","queue_duration_s":51.739071,"scheduling_latency_s":51.739107}1804gitlab # [ 238.491632] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:52.984Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"702ef778e907daa2944d9e22","created_at":"2026-11-07T12:12:01.061Z","trace_propagation_headers":{"sentry-trace":"fc6c5be11aa74a7eba41752e505a4851-6f2f6d402177436e","baggage":"sentry-trace_id=fc6c5be11aa74a7eba41752e505a4851,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYREG0C870CW3K21MHH3WX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:01.064Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-702ef778e907daa2944d9e22: done: 0.180786 sec","job_status":"done","queue_duration_s":51.739071,"scheduling_latency_s":51.739107,"redis_calls":11,"redis_duration_s":0.003254,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000886,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001848,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00052,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.14,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.14,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000335518,"duration_s":0.180786,"completed_at":"2026-11-07T12:12:52.984Z","load_balancing_strategy":"primary","db_duration_s":0.072989,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1805gitlab # [ 238.567112] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:53.060Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"3e064580278e44e9ddc8559e","created_at":"2026-11-07T12:12:01.067Z","trace_propagation_headers":{"sentry-trace":"fc6c5be11aa74a7eba41752e505a4851-6f2f6d402177436e","baggage":"sentry-trace_id=fc6c5be11aa74a7eba41752e505a4851,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYREG0C870CW3K21MHH3WX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:01.070Z","job_size_bytes":89,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-3e064580278e44e9ddc8559e: start","job_status":"start","queue_duration_s":51.989747,"scheduling_latency_s":51.989774}1806gitlab # [ 238.615868] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:53.108Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"3e064580278e44e9ddc8559e","created_at":"2026-11-07T12:12:01.067Z","trace_propagation_headers":{"sentry-trace":"fc6c5be11aa74a7eba41752e505a4851-6f2f6d402177436e","baggage":"sentry-trace_id=fc6c5be11aa74a7eba41752e505a4851,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYREG0C870CW3K21MHH3WX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:01.070Z","job_size_bytes":89,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-3e064580278e44e9ddc8559e: done: 0.048881 sec","job_status":"done","queue_duration_s":51.989747,"scheduling_latency_s":51.989774,"redis_calls":11,"redis_duration_s":0.003816,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001288,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001794,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000734,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000429943,"duration_s":0.048881,"completed_at":"2026-11-07T12:12:53.108Z","load_balancing_strategy":"primary","db_duration_s":0.00662,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1807gitlab # [ 238.617767] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:53.110Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 356d7b11eb1d1152b4ae5590f7516adaa4143e15 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"8905f9ca2dfe143712e65271","created_at":"2026-11-07T12:12:07.673Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-01b939908fbb4c1c","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:12:07.695Z","job_size_bytes":185,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-8905f9ca2dfe143712e65271: start","job_status":"start","queue_duration_s":45.415611,"scheduling_latency_s":45.415635}1808gitlab # [ 238.665838] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:53.125Z","message":"changes: \"0000000000000000000000000000000000000000 356d7b11eb1d1152b4ae5590f7516adaa4143e15 refs/heads/master\\n\""}1809gitlab # [ 238.667350] gitaly[909]: time="2026-11-07T12:12:53.156Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:13:03.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:53.145" grpc.time_ms=10.955 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810gitlab # [ 238.677544] gitaly[909]: time="2026-11-07T12:12:53.170Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-11-07T12:13:03.020" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:53.160" grpc.time_ms=10.18 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab # [ 238.720587] gitaly[909]: time="2026-11-07T12:12:53.214Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-11-07T12:13:03.062" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:53.203" grpc.time_ms=10.588 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1812gitlab # [ 238.755870] gitaly[909]: time="2026-11-07T12:12:53.249Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:53.248" grpc.time_ms=0.64 pid=909 span.kind=server system=grpc1813gitlab # [ 238.791034] gitaly[909]: time="2026-11-07T12:12:53.284Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:53.283" grpc.time_ms=0.406 pid=909 span.kind=server system=grpc1814gitlab # [ 238.809778] gitaly[909]: time="2026-11-07T12:12:53.303Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP diskcache=0c1e4149-9321-45ef-bccb-ce2c99c9ac8b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-11-07T12:13:03.086" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:53.226" pid=909 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1815gitlab # [ 238.810451] gitaly[909]: time="2026-11-07T12:12:53.303Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=69 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5110 command.oublock=8 command.real_time_ms=69 command.spawn_token_fork_ms=1 command.system_time_ms=43 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-11-07T12:13:03.086" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:53.226" grpc.time_ms=77.07 pid=909 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1816gitlab # [ 238.827038] gitaly[909]: time="2026-11-07T12:12:53.320Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-11-07T12:13:03.179" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:53.320" grpc.time_ms=0.217 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1817gitlab # [ 238.841684] gitaly[909]: time="2026-11-07T12:12:53.335Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=934 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-11-07T12:13:03.184" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:53.324" grpc.time_ms=10.025 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1818gitlab # [ 238.934990] gitaly[909]: time="2026-11-07T12:12:53.428Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-11-07T12:13:23.020" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:53.421" grpc.time_ms=7.331 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1819gitlab # [ 238.957245] gitaly[909]: time="2026-11-07T12:12:53.450Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-11-07T12:13:03.009" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:53.450" grpc.time_ms=0.187 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1820gitlab # [ 238.965394] gitaly[909]: time="2026-11-07T12:12:53.458Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=339 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-11-07T12:13:03.011" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-11-07T12:12:53.452" grpc.time_ms=6.351 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1821gitlab # [ 238.982821] gitaly[909]: time="2026-11-07T12:12:53.476Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:13:03.027" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:53.467" grpc.time_ms=8.729 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1822gitlab # [ 238.995484] gitaly[909]: time="2026-11-07T12:12:53.488Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:13:03.043" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:53.483" grpc.time_ms=5.209 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1823gitlab # [ 239.016649] gitaly[909]: time="2026-11-07T12:12:53.510Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-11-07T12:13:23.100" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:53.500" grpc.time_ms=8.934 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1824gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686'1825gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686', in 0.04 seconds)1826gitlab # [ 239.120095] nixbot[2628]: {"ts": "2026-11-07T12:12:53.612Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:49004 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 HTTP/1.1\" 200"}1827gitlab # [ 239.376740] gitaly[909]: time="2026-11-07T12:12:53.870Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-11-07T12:13:03.008" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:53.868" grpc.time_ms=1.092 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1828gitlab # [ 239.419815] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:53.912Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 356d7b11eb1d1152b4ae5590f7516adaa4143e15 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"8905f9ca2dfe143712e65271","created_at":"2026-11-07T12:12:07.673Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-01b939908fbb4c1c","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:12:07.695Z","job_size_bytes":185,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-8905f9ca2dfe143712e65271: done: 0.801463 sec","job_status":"done","queue_duration_s":45.415611,"scheduling_latency_s":45.415635,"gitaly_calls":13,"gitaly_duration_s":0.194421,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.042526,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.003691,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006192,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001374,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004748,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.015684,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.010837,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.159,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.18,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.051,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.492963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000437486,"exclusive_lock_hold_duration_s":0.025188956000000002,"duration_s":0.801463,"completed_at":"2026-11-07T12:12:53.912Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.090587,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1829gitlab # [ 239.482091] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:53.914Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"8495b0b06c0aa3db06f02cda","created_at":"2026-11-07T12:12:12.820Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-c3d72e5a65bd4de4","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:12.824Z","job_size_bytes":65,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-8495b0b06c0aa3db06f02cda: start","job_status":"start","queue_duration_s":41.089963,"scheduling_latency_s":41.089994}1830gitlab # [ 239.508892] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:54.001Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"8495b0b06c0aa3db06f02cda","created_at":"2026-11-07T12:12:12.820Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-c3d72e5a65bd4de4","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:12.824Z","job_size_bytes":65,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-8495b0b06c0aa3db06f02cda: done: 0.087366 sec","job_status":"done","queue_duration_s":41.089963,"scheduling_latency_s":41.089994,"redis_calls":16,"redis_duration_s":0.003095,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001648,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00108,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214273,"duration_s":0.087366,"completed_at":"2026-11-07T12:12:54.001Z","load_balancing_strategy":"primary","db_duration_s":0.033702,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1831gitlab # [ 239.510136] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:54.003Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c2de6c8af8ccbd9ff0ed69db","created_at":"2026-11-07T12:12:12.825Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-c3d72e5a65bd4de4","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:12.827Z","job_size_bytes":65,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c2de6c8af8ccbd9ff0ed69db: start","job_status":"start","queue_duration_s":41.175973,"scheduling_latency_s":41.175987}1832gitlab # [ 239.583423] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:54.076Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c2de6c8af8ccbd9ff0ed69db","created_at":"2026-11-07T12:12:12.825Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-c3d72e5a65bd4de4","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:12.827Z","job_size_bytes":65,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c2de6c8af8ccbd9ff0ed69db: done: 0.073078 sec","job_status":"done","queue_duration_s":41.175973,"scheduling_latency_s":41.175987,"redis_calls":21,"redis_duration_s":0.004606,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002023,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001345,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001238,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000282438,"duration_s":0.073078,"completed_at":"2026-11-07T12:12:54.076Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028856,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1833gitlab # [ 239.585483] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:54.077Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7f54133f4eb6da9fd31ea705","created_at":"2026-11-07T12:12:12.916Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-c3d72e5a65bd4de4","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:12.921Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7f54133f4eb6da9fd31ea705: start","job_status":"start","queue_duration_s":41.156783,"scheduling_latency_s":41.156796}1834gitlab # [ 239.806155] gitaly[909]: time="2026-11-07T12:12:54.299Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:54.298" grpc.time_ms=0.608 pid=909 span.kind=server system=grpc1835gitlab # [ 239.858934] gitaly[909]: time="2026-11-07T12:12:54.352Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:54.351" grpc.time_ms=0.513 pid=909 span.kind=server system=grpc1836gitlab # [ 239.911285] gitaly[909]: time="2026-11-07T12:12:54.404Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:54.404" grpc.time_ms=0.481 pid=909 span.kind=server system=grpc1837gitlab # [ 239.940554] gitaly[909]: time="2026-11-07T12:12:54.434Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 diskcache=4d73b26f-182a-4483-96fe-5150c264c75e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-11-07T12:13:24.063" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:54.263" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1838gitlab # [ 239.954363] gitaly[909]: time="2026-11-07T12:12:54.434Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=159 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7419 command.oublock=0 command.real_time_ms=158 command.spawn_token_fork_ms=0 command.system_time_ms=106 command.user_time_ms=53 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-11-07T12:13:24.063" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:54.263" grpc.time_ms=170.287 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1839gitlab # [ 240.047273] gitaly[909]: time="2026-11-07T12:12:54.540Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-11-07T12:13:24.138" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:54.539" grpc.time_ms=1.241 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1840gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686'1841gitlab # [ 240.123755] gitaly[909]: time="2026-11-07T12:12:54.617Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRTVD1GMPWS8E768AFT32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:24.215" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:54.616" grpc.time_ms=0.874 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1842gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686', in 0.04 seconds)1843gitlab # [ 240.143287] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:54.636Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7f54133f4eb6da9fd31ea705","created_at":"2026-11-07T12:12:12.916Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-c3d72e5a65bd4de4","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:12.921Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2500,"job_status":"rescheduled","message":"PipelineProcessWorker JID-7f54133f4eb6da9fd31ea705: rescheduled"}1844gitlab # [ 240.155380] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:54.648Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7f54133f4eb6da9fd31ea705","created_at":"2026-11-07T12:12:12.916Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-c3d72e5a65bd4de4","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:12.921Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7f54133f4eb6da9fd31ea705: done: 0.570542 sec","job_status":"done","queue_duration_s":41.156783,"scheduling_latency_s":41.156796,"gitaly_calls":3,"gitaly_duration_s":0.207222,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.030994,"redis_read_bytes":460,"redis_write_bytes":29295,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00144,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.0016,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.011298,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.004277,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15583,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.006984,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000668,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":165,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000695,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002592,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.107,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.023,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.027,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.077,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.224731,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.455186064,"duration_s":0.570542,"completed_at":"2026-11-07T12:12:54.648Z","load_balancing_strategy":"primary","db_duration_s":0.119698,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1845gitlab # [ 240.212723] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:54.650Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","356d7b11eb1d1152b4ae5590f7516adaa4143e15 e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2ae405e96238e1cf1ba09b5c","created_at":"2026-11-07T12:12:52.423Z","trace_propagation_headers":{"sentry-trace":"5281018fd6464738a18cc3ea1576f854-80fe9f071871424f","baggage":"sentry-trace_id=5281018fd6464738a18cc3ea1576f854,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYT1BKFEVHNQ9XHYRKAAA6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:12:52.425Z","job_size_bytes":185,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2ae405e96238e1cf1ba09b5c: start","job_status":"start","queue_duration_s":2.225218,"scheduling_latency_s":2.225237}1846gitlab # [ 240.213619] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:54.658Z","message":"changes: \"356d7b11eb1d1152b4ae5590f7516adaa4143e15 e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 refs/heads/master\\n\""}1847gitlab # [ 240.214354] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:54.696Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d41203a115d0445d44fe518f","created_at":"2026-11-07T12:12:54.694Z","trace_propagation_headers":{"sentry-trace":"5281018fd6464738a18cc3ea1576f854-36b8c890b37f40c9","baggage":"sentry-trace_id=5281018fd6464738a18cc3ea1576f854,sentry-release=Unknown"},"correlation_id":"01M6TYT1BKFEVHNQ9XHYRKAAA6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"1ad5f1c94d61fd049981241a","job_size_bytes":46,"pid":2500,"job_status":"deduplicated","message":"ProjectCacheWorker JID-d41203a115d0445d44fe518f: deduplicated: until executing","deduplication.type":"until executing"}1848gitlab # [ 240.256910] gitaly[909]: time="2026-11-07T12:12:54.681Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:13:04.230" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:54.670" grpc.time_ms=10.092 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1849gitlab # [ 240.258254] nixbot[2628]: {"ts": "2026-11-07T12:12:54.652Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:49020 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 HTTP/1.1\" 200"}1850gitlab # [ 240.259071] gitaly[909]: time="2026-11-07T12:12:54.691Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-11-07T12:13:04.243" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:54.684" grpc.time_ms=7.384 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1851gitlab # [ 240.259905] gitaly[909]: time="2026-11-07T12:12:54.718Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-11-07T12:13:04.269" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:54.709" grpc.time_ms=9.077 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1852gitlab # [ 240.260845] gitaly[909]: time="2026-11-07T12:12:54.732Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-11-07T12:13:24.323" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:54.724" grpc.time_ms=8.529 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1853gitlab # [ 240.304829] gitaly[909]: time="2026-11-07T12:12:54.748Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-11-07T12:13:04.002" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-11-07T12:12:54.742" grpc.time_ms=5.008 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1854gitlab # [ 240.305620] gitaly[909]: time="2026-11-07T12:12:54.761Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:13:04.015" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:54.756" grpc.time_ms=5.202 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1855gitlab # [ 240.321983] gitaly[909]: time="2026-11-07T12:12:54.815Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-11-07T12:13:04.074" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:54.814" grpc.time_ms=0.899 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1856gitlab # [ 240.334188] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:54.827Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","356d7b11eb1d1152b4ae5590f7516adaa4143e15 e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2ae405e96238e1cf1ba09b5c","created_at":"2026-11-07T12:12:52.423Z","trace_propagation_headers":{"sentry-trace":"5281018fd6464738a18cc3ea1576f854-80fe9f071871424f","baggage":"sentry-trace_id=5281018fd6464738a18cc3ea1576f854,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYT1BKFEVHNQ9XHYRKAAA6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-11-07T12:12:52.425Z","job_size_bytes":185,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2ae405e96238e1cf1ba09b5c: done: 0.176997 sec","job_status":"done","queue_duration_s":2.225218,"scheduling_latency_s":2.225237,"gitaly_calls":7,"gitaly_duration_s":0.060554,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.016,"redis_read_bytes":501,"redis_write_bytes":11939,"redis_cache_calls":9,"redis_cache_duration_s":0.001578,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000777,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5716,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00292,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.005848,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.004877,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.016,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000464864,"exclusive_lock_hold_duration_s":0.01675632,"duration_s":0.176997,"completed_at":"2026-11-07T12:12:54.827Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018558,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1857gitlab # [ 240.375144] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:54.828Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"1ad5f1c94d61fd049981241a","created_at":"2026-11-07T12:12:53.172Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-2f97978f82754fcf","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:53.185Z","job_size_bytes":46,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-1ad5f1c94d61fd049981241a: start","job_status":"start","queue_duration_s":1.643349,"scheduling_latency_s":1.643365}1858gitlab # [ 240.375936] gitaly[909]: time="2026-11-07T12:12:54.856Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-11-07T18:12:54.854" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:54.854" grpc.time_ms=2.127 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1859gitlab # [ 240.376625] gitaly[909]: time="2026-11-07T12:12:54.867Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-11-07T12:13:24.661" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:54.861" grpc.time_ms=6.137 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1860gitlab # [ 240.422124] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:54.895Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"1ad5f1c94d61fd049981241a","created_at":"2026-11-07T12:12:53.172Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-2f97978f82754fcf","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:53.185Z","job_size_bytes":46,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-1ad5f1c94d61fd049981241a: done: 0.066927 sec","job_status":"done","queue_duration_s":1.643349,"scheduling_latency_s":1.643365,"gitaly_calls":2,"gitaly_duration_s":0.011265,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.004599,"redis_read_bytes":69,"redis_write_bytes":4885,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001006,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000465,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2113,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001088,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.001591,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000327137,"duration_s":0.066927,"completed_at":"2026-11-07T12:12:54.895Z","load_balancing_strategy":"primary","db_duration_s":0.009098,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1861gitlab # [ 240.466488] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:54.896Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"0a4efb98d36c4a3511e8ae8b","created_at":"2026-11-07T12:12:53.196Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-2f97978f82754fcf","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:53.199Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-0a4efb98d36c4a3511e8ae8b: start","job_status":"start","queue_duration_s":1.696433,"scheduling_latency_s":1.696446}1862gitlab # [ 240.467104] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:54.957Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"0a4efb98d36c4a3511e8ae8b","created_at":"2026-11-07T12:12:53.196Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-2f97978f82754fcf","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:53.199Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-0a4efb98d36c4a3511e8ae8b: done: 0.061052 sec","job_status":"done","queue_duration_s":1.696433,"scheduling_latency_s":1.696446,"gitaly_calls":1,"gitaly_duration_s":0.024345,"redis_calls":15,"redis_duration_s":0.001993,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000231,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000343,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000654,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.046860146,"duration_s":0.061052,"completed_at":"2026-11-07T12:12:54.957Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009616,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1863gitlab # [ 240.511851] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:54.958Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"6b61cbc9b1d6a02043c5637b","created_at":"2026-11-07T12:12:53.315Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-2f97978f82754fcf","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:53.317Z","job_size_bytes":23,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-6b61cbc9b1d6a02043c5637b: start","job_status":"start","queue_duration_s":1.641288,"scheduling_latency_s":1.641302}1864gitlab # [ 240.512765] gitaly[909]: time="2026-11-07T12:12:54.932Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP diskcache=31503e4f-dc3a-46a6-9f04-6d5eb69cb1ec grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-11-07T18:12:54.909" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:54.910" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1865gitlab # [ 240.513551] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:54.985Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"6b61cbc9b1d6a02043c5637b","created_at":"2026-11-07T12:12:53.315Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-2f97978f82754fcf","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:53.317Z","job_size_bytes":23,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-6b61cbc9b1d6a02043c5637b: done: 0.027445 sec","job_status":"done","queue_duration_s":1.641288,"scheduling_latency_s":1.641302,"gitaly_calls":1,"gitaly_duration_s":0.007089,"redis_calls":16,"redis_duration_s":0.002049,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000172,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000617,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.000882,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000378,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027445,"completed_at":"2026-11-07T12:12:54.985Z","load_balancing_strategy":"primary","db_duration_s":0.001693,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1866gitlab # [ 240.572162] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:54.987Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"bb9634fa0e0a286dfcf2ab72","created_at":"2026-11-07T12:12:53.702Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-2f97978f82754fcf","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ad9213c11aa1438f67eacb6c112cada842fa4d3d267e2dce0c06f6c383f26b5e","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:53.706Z","job_size_bytes":467,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-bb9634fa0e0a286dfcf2ab72: start","job_status":"start","queue_duration_s":1.280968,"scheduling_latency_s":1.280983}1867gitlab # [ 240.572903] gitaly[909]: time="2026-11-07T12:12:54.932Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1285 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-11-07T18:12:54.909" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:54.910" grpc.time_ms=22.568 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1868gitlab # [ 240.576902] gitaly[909]: time="2026-11-07T12:12:54.980Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=656 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-11-07T12:13:24.774" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:54.975" grpc.time_ms=5.486 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1869gitlab # [ 240.616844] gitaly[909]: time="2026-11-07T12:12:55.002Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:25.002" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:55.002" grpc.time_ms=0.412 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1870gitlab # [ 240.617751] gitaly[909]: time="2026-11-07T12:12:55.009Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-11-07T12:13:05.004" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:55.004" grpc.time_ms=4.489 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1871gitlab # [ 240.618505] gitaly[909]: time="2026-11-07T12:12:55.078Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-11-07T12:13:25.077" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:55.077" grpc.time_ms=0.648 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1872gitlab # [ 240.657361] gitaly[909]: time="2026-11-07T12:12:55.082Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=31 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-11-07T12:13:25.080" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:55.080" grpc.time_ms=1.676 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1873gitlab # [ 240.658141] gitaly[909]: time="2026-11-07T12:12:55.137Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:13:05.131" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:55.131" grpc.time_ms=5.713 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1874gitlab # [ 241.065381] gitaly[909]: time="2026-11-07T12:12:55.558Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-11-07T12:13:25.540" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:55.540" grpc.time_ms=17.197 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1875gitlab # [ 241.083206] gitaly[909]: time="2026-11-07T12:12:55.576Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M6TYRNC48F065SK7ZGAYKNVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-11-07T12:13:25.561" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:55.562" grpc.time_ms=14.418 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1876gitlab # [ 241.117818] sidekiq-cluster[2500]: {"severity":"WARN","time":"2026-11-07T12:12:55.611Z","class":"CreatePipelineWorker","correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"356d7b11eb1d1152b4ae5590f7516adaa4143e15","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"356d7b11eb1d1152b4ae5590f7516adaa4143e15","ref":"refs/heads/master"},"retry":0}1877gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686'1878gitlab # [ 241.126435] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.619Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"bb9634fa0e0a286dfcf2ab72","created_at":"2026-11-07T12:12:53.702Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-2f97978f82754fcf","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ad9213c11aa1438f67eacb6c112cada842fa4d3d267e2dce0c06f6c383f26b5e","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:53.706Z","job_size_bytes":467,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-bb9634fa0e0a286dfcf2ab72: done: 0.632097 sec","job_status":"done","queue_duration_s":1.280968,"scheduling_latency_s":1.280983,"gitaly_calls":7,"gitaly_duration_s":0.060149,"redis_calls":51,"redis_duration_s":0.007317000000000001,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.00051,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003503,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000885,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001624,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000795,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.529709,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003696,"duration_s":0.632097,"completed_at":"2026-11-07T12:12:55.619Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032361,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1879gitlab # [ 241.133834] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.621Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"b60572b1-f095-462a-95d7-d196de57130c\"}"],"class":"WebHookWorker","jid":"c7effe17a70e0c9a1547426c","created_at":"2026-11-07T12:12:53.844Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-2f97978f82754fcf","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8fb11e02cc069fa7561ffe8672b24d730a41721dac69964421e4eebbed303a6b","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:53.849Z","job_size_bytes":1751,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c7effe17a70e0c9a1547426c: start","job_status":"start","queue_duration_s":1.771388,"scheduling_latency_s":1.771412}1880gitlab # [ 241.221698] nixbot[2628]: {"ts": "2026-11-07T12:12:55.715Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "9a438e91-d76a-4bac-855e-7ca177d58421", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "356d7b11eb1d1152b4ae5590f7516adaa4143e15", "pr": null}1881gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686', in 0.06 seconds)1882gitlab # [ 241.223671] nixbot[2628]: {"ts": "2026-11-07T12:12:55.717Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:49042 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 HTTP/1.1\" 200"}1883gitlab # [ 241.230731] nixbot[2628]: {"ts": "2026-11-07T12:12:55.724Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:49034 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}1884gitlab # [ 241.248186] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.741Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"b60572b1-f095-462a-95d7-d196de57130c\"}"],"class":"WebHookWorker","jid":"c7effe17a70e0c9a1547426c","created_at":"2026-11-07T12:12:53.844Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-2f97978f82754fcf","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8fb11e02cc069fa7561ffe8672b24d730a41721dac69964421e4eebbed303a6b","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:53.849Z","job_size_bytes":1751,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c7effe17a70e0c9a1547426c: done: 0.120198 sec","job_status":"done","queue_duration_s":1.771388,"scheduling_latency_s":1.771412,"redis_calls":19,"redis_duration_s":0.003777,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000931,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000475,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001687,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000684,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.04102001799998334,"cpu_s":0.067071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000292216,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.120198,"completed_at":"2026-11-07T12:12:55.741Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1885gitlab # [ 241.253507] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.746Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9b67f2af7e3f577e55a2bb37","created_at":"2026-11-07T12:12:54.251Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.255Z","job_size_bytes":23,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9b67f2af7e3f577e55a2bb37: start","job_status":"start","queue_duration_s":1.491322,"scheduling_latency_s":1.491337}1886gitlab # [ 241.301128] gitaly[909]: time="2026-11-07T12:12:55.794Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT51XR3YWK9JXQ4A8DQNM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:55.785" grpc.time_ms=8.723 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1887gitlab # [ 241.308134] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:55 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 551888gitlab # [ 241.319241] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.812Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9b67f2af7e3f577e55a2bb37","created_at":"2026-11-07T12:12:54.251Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.255Z","job_size_bytes":23,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9b67f2af7e3f577e55a2bb37: done: 0.065521 sec","job_status":"done","queue_duration_s":1.491322,"scheduling_latency_s":1.491337,"redis_calls":10,"redis_duration_s":0.003973,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000436,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00212,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001417,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000288025,"duration_s":0.065521,"completed_at":"2026-11-07T12:12:55.812Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017485,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1889gitlab # [ 241.321915] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.815Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"db1767413c565c902b13ddac","created_at":"2026-11-07T12:12:54.441Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.447Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-db1767413c565c902b13ddac: start","job_status":"start","queue_duration_s":1.367286,"scheduling_latency_s":1.3673}1890gitlab # [ 241.363375] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.837Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"db1767413c565c902b13ddac","created_at":"2026-11-07T12:12:54.441Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.447Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-db1767413c565c902b13ddac: done: 0.022025 sec","job_status":"done","queue_duration_s":1.367286,"scheduling_latency_s":1.3673,"redis_calls":10,"redis_duration_s":0.0017109999999999998,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000375,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000322,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00021539,"duration_s":0.022025,"completed_at":"2026-11-07T12:12:55.837Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002721,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1891gitlab # [ 241.402685] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.838Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"2f9fd08a574c62333c38a5d9","created_at":"2026-11-07T12:12:54.463Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.471Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-2f9fd08a574c62333c38a5d9: start","job_status":"start","queue_duration_s":1.3664,"scheduling_latency_s":1.366447}1892gitlab # [ 241.407211] gitlab-workhorse[825]: time="2026-11-07T12:12:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671893gitlab # [ 241.407922] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:55 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 491894gitlab # [ 241.408369] gitlab-workhorse[825]: time="2026-11-07T12:12:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3411895gitlab # [ 241.408896] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:55 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 341 "" "git/2.55.0" 451896gitlab # [ 241.409561] gitaly[909]: time="2026-11-07T12:12:55.848Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT53QJR268YTDB8ZMWJDN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:55.838" pid=909 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1897gitlab # [ 241.410078] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.870Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"2f9fd08a574c62333c38a5d9","created_at":"2026-11-07T12:12:54.463Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.471Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-2f9fd08a574c62333c38a5d9: done: 0.032026 sec","job_status":"done","queue_duration_s":1.3664,"scheduling_latency_s":1.366447,"redis_calls":10,"redis_duration_s":0.001607,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000229,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001042,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000336,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000410108,"duration_s":0.032026,"completed_at":"2026-11-07T12:12:55.870Z","load_balancing_strategy":"primary","db_duration_s":0.006184,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1898gitlab # [ 241.449743] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.871Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"92fe4e2c92c978a99cbe122f","created_at":"2026-11-07T12:12:54.487Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.492Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-92fe4e2c92c978a99cbe122f: start","job_status":"start","queue_duration_s":1.378422,"scheduling_latency_s":1.378437}1899gitlab # [ 241.457140] gitaly[909]: time="2026-11-07T12:12:55.848Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT53QJR268YTDB8ZMWJDN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:55.838" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1900gitlab # [ 241.469254] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.898Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"92fe4e2c92c978a99cbe122f","created_at":"2026-11-07T12:12:54.487Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.492Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-92fe4e2c92c978a99cbe122f: done: 0.026972 sec","job_status":"done","queue_duration_s":1.378422,"scheduling_latency_s":1.378437,"redis_calls":13,"redis_duration_s":0.0021,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001191,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000396,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000224889,"duration_s":0.026972,"completed_at":"2026-11-07T12:12:55.898Z","load_balancing_strategy":"primary","db_duration_s":0.006019,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1901gitlab # [ 241.510089] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.899Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"595cffe76bd15227e8677529","created_at":"2026-11-07T12:12:54.493Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.498Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-595cffe76bd15227e8677529: start","job_status":"start","queue_duration_s":1.401215,"scheduling_latency_s":1.401228}1902gitlab # [ 241.548562] gitaly[909]: time="2026-11-07T12:12:55.848Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT53QJR268YTDB8ZMWJDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:55.838" grpc.time_ms=9.707 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1903gitlab # [ 241.549497] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.919Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"595cffe76bd15227e8677529","created_at":"2026-11-07T12:12:54.493Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.498Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-595cffe76bd15227e8677529: done: 0.020151 sec","job_status":"done","queue_duration_s":1.401215,"scheduling_latency_s":1.401228,"redis_calls":10,"redis_duration_s":0.002065,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000309,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000756,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000193321,"duration_s":0.020151,"completed_at":"2026-11-07T12:12:55.919Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002836,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1904gitlab # [ 241.611661] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.920Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1538a4ff7c20ea91f35f6f75","created_at":"2026-11-07T12:12:54.498Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.502Z","job_size_bytes":19,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1538a4ff7c20ea91f35f6f75: start","job_status":"start","queue_duration_s":1.417402,"scheduling_latency_s":1.417415}1905gitlab # [ 241.612446] gitaly[909]: time="2026-11-07T12:12:55.896Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT55A6A7TB2K1T3FWDEQZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:55.886" pid=909 remote_ip="2001:db8:1::1" request_sha=568e65523b99d12514b67db5454ed9efb3181afa response_bytes=341 span.kind=server system=grpc1906gitlab # [ 241.613097] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.937Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1538a4ff7c20ea91f35f6f75","created_at":"2026-11-07T12:12:54.498Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.502Z","job_size_bytes":19,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1538a4ff7c20ea91f35f6f75: done: 0.017085 sec","job_status":"done","queue_duration_s":1.417402,"scheduling_latency_s":1.417415,"redis_calls":11,"redis_duration_s":0.001277,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00023,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000225,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196393,"duration_s":0.017085,"completed_at":"2026-11-07T12:12:55.937Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002146,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1907gitlab # [ 241.658729] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.938Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e31cafbeaca801f5e2731da8","created_at":"2026-11-07T12:12:54.505Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.507Z","job_size_bytes":66,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e31cafbeaca801f5e2731da8: start","job_status":"start","queue_duration_s":1.430586,"scheduling_latency_s":1.430598}1908gitlab # [ 241.659488] gitaly[909]: time="2026-11-07T12:12:55.896Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1188 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT55A6A7TB2K1T3FWDEQZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:55.886" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1909gitlab # [ 241.667620] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.957Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e31cafbeaca801f5e2731da8","created_at":"2026-11-07T12:12:54.505Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.507Z","job_size_bytes":66,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e31cafbeaca801f5e2731da8: done: 0.019141 sec","job_status":"done","queue_duration_s":1.430586,"scheduling_latency_s":1.430598,"redis_calls":10,"redis_duration_s":0.0011949999999999999,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194438,"duration_s":0.019141,"completed_at":"2026-11-07T12:12:55.957Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003434,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1910gitlab # [ 241.726116] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.958Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"20408a1ebb1deaad5c78b5f7","created_at":"2026-11-07T12:12:54.508Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.510Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-20408a1ebb1deaad5c78b5f7: start","job_status":"start","queue_duration_s":1.447356,"scheduling_latency_s":1.447369}1911gitlab # [ 241.726894] gitaly[909]: time="2026-11-07T12:12:55.896Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1188 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT55A6A7TB2K1T3FWDEQZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:55.886" grpc.time_ms=10.215 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1912gitlab # [ 241.773762] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.981Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"20408a1ebb1deaad5c78b5f7","created_at":"2026-11-07T12:12:54.508Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.510Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-20408a1ebb1deaad5c78b5f7: done: 0.022895 sec","job_status":"done","queue_duration_s":1.447356,"scheduling_latency_s":1.447369,"redis_calls":10,"redis_duration_s":0.001193,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00023,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000725,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000190527,"duration_s":0.022895,"completed_at":"2026-11-07T12:12:55.981Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002876,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1913gitlab # [ 241.775620] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:55.982Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"21ccaf28260794cb9d924c53","created_at":"2026-11-07T12:12:54.515Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.517Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-21ccaf28260794cb9d924c53: start","job_status":"start","queue_duration_s":1.464364,"scheduling_latency_s":1.464377}1914gitlab # [ 241.790139] gitaly[909]: time="2026-11-07T12:12:56.119Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 diskcache=30c29506-e88a-4e43-b40d-1a97bfc7c719 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-11-07T18:12:56.107" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:56.107" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1915gitlab # [ 241.799061] gitaly[909]: time="2026-11-07T12:12:56.119Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-11-07T18:12:56.107" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:56.107" grpc.time_ms=11.339 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1916gitlab # [ 241.810968] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.003Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"21ccaf28260794cb9d924c53","created_at":"2026-11-07T12:12:54.515Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.517Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-21ccaf28260794cb9d924c53: done: 0.02157 sec","job_status":"done","queue_duration_s":1.464364,"scheduling_latency_s":1.464377,"redis_calls":10,"redis_duration_s":0.0012230000000000001,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000737,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203657,"duration_s":0.02157,"completed_at":"2026-11-07T12:12:56.003Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005583,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1917gitlab # [ 241.856355] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.004Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"fb037d4e9b9547043cf3b761","created_at":"2026-11-07T12:12:54.518Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.520Z","job_size_bytes":6,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-fb037d4e9b9547043cf3b761: start","job_status":"start","queue_duration_s":1.483926,"scheduling_latency_s":1.483938}1918gitlab # [ 241.864198] gitaly[909]: time="2026-11-07T12:12:56.142Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:26.141" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:56.141" grpc.time_ms=0.454 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1919gitlab # [ 241.911107] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.017Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"fb037d4e9b9547043cf3b761","created_at":"2026-11-07T12:12:54.518Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.520Z","job_size_bytes":6,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-fb037d4e9b9547043cf3b761: done: 0.013241 sec","job_status":"done","queue_duration_s":1.483926,"scheduling_latency_s":1.483938,"redis_calls":10,"redis_duration_s":0.001278,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000233,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000804,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000291657,"duration_s":0.013241,"completed_at":"2026-11-07T12:12:56.017Z","load_balancing_strategy":"primary","db_duration_s":0.001229,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1920gitlab # [ 241.913573] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.018Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"866dde8836b8c127e7ce1b9f","created_at":"2026-11-07T12:12:54.521Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.523Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-866dde8836b8c127e7ce1b9f: start","job_status":"start","queue_duration_s":1.495092,"scheduling_latency_s":1.495104}1921gitlab # [ 241.957558] gitaly[909]: time="2026-11-07T12:12:56.148Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-11-07T12:13:06.143" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:56.143" grpc.time_ms=4.748 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1922gitlab # [ 241.958220] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.039Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"866dde8836b8c127e7ce1b9f","created_at":"2026-11-07T12:12:54.521Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.523Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-866dde8836b8c127e7ce1b9f: done: 0.020527 sec","job_status":"done","queue_duration_s":1.495092,"scheduling_latency_s":1.495104,"redis_calls":10,"redis_duration_s":0.001248,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000777,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000200025,"duration_s":0.020527,"completed_at":"2026-11-07T12:12:56.039Z","load_balancing_strategy":"primary","db_duration_s":0.00381,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1923gitlab # [ 241.976589] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.040Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"5908426bcd08d7d222cb11dc","created_at":"2026-11-07T12:12:54.527Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.530Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-5908426bcd08d7d222cb11dc: start","job_status":"start","queue_duration_s":1.509456,"scheduling_latency_s":1.509468}1924gitlab # [ 242.016451] gitaly[909]: time="2026-11-07T12:12:56.168Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-11-07T12:13:26.167" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:56.168" grpc.time_ms=0.543 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1925gitlab # [ 242.017053] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.078Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"5908426bcd08d7d222cb11dc","created_at":"2026-11-07T12:12:54.527Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.530Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-5908426bcd08d7d222cb11dc: done: 0.038152 sec","job_status":"done","queue_duration_s":1.509456,"scheduling_latency_s":1.509468,"redis_calls":14,"redis_duration_s":0.002182,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000232,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001039,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000293054,"duration_s":0.038152,"completed_at":"2026-11-07T12:12:56.078Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007431,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1926gitlab # [ 242.055745] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.079Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e13cc128dddf638c0794d203","created_at":"2026-11-07T12:12:54.636Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.640Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e13cc128dddf638c0794d203: start","job_status":"start","queue_duration_s":1.439174,"scheduling_latency_s":1.439189}1927gitlab # [ 242.056629] gitaly[909]: time="2026-11-07T12:12:56.174Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=39 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-11-07T12:13:26.172" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:56.172" grpc.time_ms=1.54 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1928gitlab # [ 242.101724] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.096Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e13cc128dddf638c0794d203","created_at":"2026-11-07T12:12:54.636Z","trace_propagation_headers":{"sentry-trace":"db8f153fff3443ee93657b941209920c-24481be3a2454292","baggage":"sentry-trace_id=db8f153fff3443ee93657b941209920c,sentry-release=Unknown"},"correlation_id":"01M6TYRTVD1GMPWS8E768AFT32","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.640Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e13cc128dddf638c0794d203: done: 0.016861 sec","job_status":"done","queue_duration_s":1.439174,"scheduling_latency_s":1.439189,"redis_calls":8,"redis_duration_s":0.001018,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000784,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016861,"completed_at":"2026-11-07T12:12:56.096Z","load_balancing_strategy":"primary","db_duration_s":0.002198,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1929gitlab # [ 242.141736] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.096Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"93697504e5f3d1f92681884d","created_at":"2026-11-07T12:12:54.703Z","trace_propagation_headers":{"sentry-trace":"5281018fd6464738a18cc3ea1576f854-36b8c890b37f40c9","baggage":"sentry-trace_id=5281018fd6464738a18cc3ea1576f854,sentry-release=Unknown"},"correlation_id":"01M6TYT1BKFEVHNQ9XHYRKAAA6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"0a4efb98d36c4a3511e8ae8b","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.705Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-93697504e5f3d1f92681884d: start","job_status":"start","queue_duration_s":1.391512,"scheduling_latency_s":1.391525}1930gitlab # [ 242.142956] gitaly[909]: time="2026-11-07T12:12:56.195Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:13:06.191" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:56.191" grpc.time_ms=4.61 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1931gitlab # [ 242.144058] nixbot[2628]: {"ts": "2026-11-07T12:12:56.576Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "d50a16cf-db76-44db-87a5-d9dea0aae5bb", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "e3f8e82aecb9f4e4ea270ab48ee1a63907feb686", "pr": null}1932gitlab # [ 242.144384] nixbot[2628]: {"ts": "2026-11-07T12:12:56.580Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:49048 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}1933gitlab # [ 242.144922] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.127Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"93697504e5f3d1f92681884d","created_at":"2026-11-07T12:12:54.703Z","trace_propagation_headers":{"sentry-trace":"5281018fd6464738a18cc3ea1576f854-36b8c890b37f40c9","baggage":"sentry-trace_id=5281018fd6464738a18cc3ea1576f854,sentry-release=Unknown"},"correlation_id":"01M6TYT1BKFEVHNQ9XHYRKAAA6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"0a4efb98d36c4a3511e8ae8b","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.705Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-93697504e5f3d1f92681884d: done: 0.031064 sec","job_status":"done","queue_duration_s":1.391512,"scheduling_latency_s":1.391525,"gitaly_calls":1,"gitaly_duration_s":0.013165,"redis_calls":12,"redis_duration_s":0.0018,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000633,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000342,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000825,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.020724701,"duration_s":0.031064,"completed_at":"2026-11-07T12:12:56.127Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002452,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1934gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686'1935gitlab # [ 242.195448] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.128Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"2406ff4f55ef07ef21b43c56","created_at":"2026-11-07T12:12:54.793Z","trace_propagation_headers":{"sentry-trace":"5281018fd6464738a18cc3ea1576f854-36b8c890b37f40c9","baggage":"sentry-trace_id=5281018fd6464738a18cc3ea1576f854,sentry-release=Unknown"},"correlation_id":"01M6TYT1BKFEVHNQ9XHYRKAAA6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ff59b3fda696ade5063ca1b9c195f705a9b576583d9fb9c61aead8f89998586a","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.794Z","job_size_bytes":467,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-2406ff4f55ef07ef21b43c56: start","job_status":"start","queue_duration_s":1.334059,"scheduling_latency_s":1.334073}1936gitlab # [ 242.196138] gitaly[909]: time="2026-11-07T12:12:56.541Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-11-07T12:13:26.533" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:56.533" grpc.time_ms=8.113 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937gitlab # [ 242.236197] sidekiq-cluster[2500]: {"severity":"WARN","time":"2026-11-07T12:12:56.557Z","class":"CreatePipelineWorker","correlation_id":"01M6TYT1BKFEVHNQ9XHYRKAAA6","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"356d7b11eb1d1152b4ae5590f7516adaa4143e15","after":"e3f8e82aecb9f4e4ea270ab48ee1a63907feb686","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"e3f8e82aecb9f4e4ea270ab48ee1a63907feb686","ref":"refs/heads/master"},"retry":0}1938gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686', in 0.04 seconds)1939gitlab # [ 242.236817] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.560Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"2406ff4f55ef07ef21b43c56","created_at":"2026-11-07T12:12:54.793Z","trace_propagation_headers":{"sentry-trace":"5281018fd6464738a18cc3ea1576f854-36b8c890b37f40c9","baggage":"sentry-trace_id=5281018fd6464738a18cc3ea1576f854,sentry-release=Unknown"},"correlation_id":"01M6TYT1BKFEVHNQ9XHYRKAAA6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ff59b3fda696ade5063ca1b9c195f705a9b576583d9fb9c61aead8f89998586a","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.794Z","job_size_bytes":467,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-2406ff4f55ef07ef21b43c56: done: 0.431584 sec","job_status":"done","queue_duration_s":1.334059,"scheduling_latency_s":1.334073,"gitaly_calls":7,"gitaly_duration_s":0.038369,"redis_calls":33,"redis_duration_s":0.002963,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000344,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001417,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000575,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.381962,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.431584,"completed_at":"2026-11-07T12:12:56.560Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010072,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1940gitlab # [ 242.275192] gitaly[909]: time="2026-11-07T12:12:56.550Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT1BKFEVHNQ9XHYRKAAA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-11-07T12:13:26.543" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:56.543" grpc.time_ms=6.791 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1941gitlab # [ 242.275896] nixbot[2628]: {"ts": "2026-11-07T12:12:56.757Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:49064 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 HTTP/1.1\" 200"}1942gitlab # [ 242.276504] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.561Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"b9b069b4-caf7-4e22-8945-7e501f1dab4d\"}"],"class":"WebHookWorker","jid":"a8e26b61531b8d95ef2501ab","created_at":"2026-11-07T12:12:54.805Z","trace_propagation_headers":{"sentry-trace":"5281018fd6464738a18cc3ea1576f854-36b8c890b37f40c9","baggage":"sentry-trace_id=5281018fd6464738a18cc3ea1576f854,sentry-release=Unknown"},"correlation_id":"01M6TYT1BKFEVHNQ9XHYRKAAA6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3ab6410e3082eaa8ebbfdc89149d7dbd4bfe378daade9b297138b9637d271946","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.806Z","job_size_bytes":1749,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-a8e26b61531b8d95ef2501ab: start","job_status":"start","queue_duration_s":1.754996,"scheduling_latency_s":1.755033}1943gitlab # [ 242.283163] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.585Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"b9b069b4-caf7-4e22-8945-7e501f1dab4d\"}"],"class":"WebHookWorker","jid":"a8e26b61531b8d95ef2501ab","created_at":"2026-11-07T12:12:54.805Z","trace_propagation_headers":{"sentry-trace":"5281018fd6464738a18cc3ea1576f854-36b8c890b37f40c9","baggage":"sentry-trace_id=5281018fd6464738a18cc3ea1576f854,sentry-release=Unknown"},"correlation_id":"01M6TYT1BKFEVHNQ9XHYRKAAA6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3ab6410e3082eaa8ebbfdc89149d7dbd4bfe378daade9b297138b9637d271946","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.806Z","job_size_bytes":1749,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-a8e26b61531b8d95ef2501ab: done: 0.024242 sec","job_status":"done","queue_duration_s":1.754996,"scheduling_latency_s":1.755033,"redis_calls":14,"redis_duration_s":0.001513,"redis_read_bytes":25,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000204,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00084,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000469,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.0056593790000079025,"cpu_s":0.01407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.024242,"completed_at":"2026-11-07T12:12:56.585Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1944gitlab # [ 242.330528] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.586Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"6eb80899c90e9ae429a2055b","created_at":"2026-11-07T12:12:54.878Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-a0eae35b70ad4ad4","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.883Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-6eb80899c90e9ae429a2055b: start","job_status":"start","queue_duration_s":1.70321,"scheduling_latency_s":1.703224}1945gitlab # [ 242.338626] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.614Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"6eb80899c90e9ae429a2055b","created_at":"2026-11-07T12:12:54.878Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-a0eae35b70ad4ad4","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:54.883Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-6eb80899c90e9ae429a2055b: done: 0.027552 sec","job_status":"done","queue_duration_s":1.70321,"scheduling_latency_s":1.703224,"redis_calls":19,"redis_duration_s":0.0024029999999999998,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000471,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000291,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001215,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000426,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.004414248,"duration_s":0.027552,"completed_at":"2026-11-07T12:12:56.614Z","load_balancing_strategy":"primary","db_duration_s":0.004559,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1946gitlab # [ 242.398218] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.615Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c7effe17a70e0c9a1547426c"],"class":"WebHooks::LogExecutionWorker","jid":"c1c9f7d0ab04b0e905dff76d","created_at":"2026-11-07T12:12:55.727Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-0c38d791c8424da5","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:39838778b798f96687bb0cbb2dfc849057906aa63c514ecb66f3a66b42b35b6e","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:55.735Z","job_size_bytes":2593,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-c1c9f7d0ab04b0e905dff76d: start","job_status":"start","queue_duration_s":0.879917,"scheduling_latency_s":0.87993}1947gitlab # [ 242.398824] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.642Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c7effe17a70e0c9a1547426c"],"class":"WebHooks::LogExecutionWorker","jid":"c1c9f7d0ab04b0e905dff76d","created_at":"2026-11-07T12:12:55.727Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-0c38d791c8424da5","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:39838778b798f96687bb0cbb2dfc849057906aa63c514ecb66f3a66b42b35b6e","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:55.735Z","job_size_bytes":2593,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-c1c9f7d0ab04b0e905dff76d: done: 0.027389 sec","job_status":"done","queue_duration_s":0.879917,"scheduling_latency_s":0.87993,"redis_calls":10,"redis_duration_s":0.001253,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000759,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212876,"duration_s":0.027389,"completed_at":"2026-11-07T12:12:56.642Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004855,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1948gitlab # [ 242.465062] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.643Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","a8e26b61531b8d95ef2501ab"],"class":"WebHooks::LogExecutionWorker","jid":"1ce78f7b311d7f997828fc28","created_at":"2026-11-07T12:12:56.581Z","trace_propagation_headers":{"sentry-trace":"5281018fd6464738a18cc3ea1576f854-a34d9f46fa4e4fb5","baggage":"sentry-trace_id=5281018fd6464738a18cc3ea1576f854,sentry-release=Unknown"},"correlation_id":"01M6TYT1BKFEVHNQ9XHYRKAAA6","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:932878f5b26b51bbc8963a0dbe15a9637e2e55103dd35415c827930b487789a3","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:56.582Z","job_size_bytes":2591,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-1ce78f7b311d7f997828fc28: start","job_status":"start","queue_duration_s":0.061037,"scheduling_latency_s":0.06105}1949gitlab # [ 242.465734] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.658Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","a8e26b61531b8d95ef2501ab"],"class":"WebHooks::LogExecutionWorker","jid":"1ce78f7b311d7f997828fc28","created_at":"2026-11-07T12:12:56.581Z","trace_propagation_headers":{"sentry-trace":"5281018fd6464738a18cc3ea1576f854-a34d9f46fa4e4fb5","baggage":"sentry-trace_id=5281018fd6464738a18cc3ea1576f854,sentry-release=Unknown"},"correlation_id":"01M6TYT1BKFEVHNQ9XHYRKAAA6","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:932878f5b26b51bbc8963a0dbe15a9637e2e55103dd35415c827930b487789a3","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:56.582Z","job_size_bytes":2591,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-1ce78f7b311d7f997828fc28: done: 0.014841 sec","job_status":"done","queue_duration_s":0.061037,"scheduling_latency_s":0.06105,"redis_calls":7,"redis_duration_s":0.000893,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014841,"completed_at":"2026-11-07T12:12:56.658Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00267,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1950gitlab # [ 242.486773] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.659Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"5b8d12bdbc7eaaff37c45e6b","created_at":"2026-11-07T12:12:56.606Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-0800f9a9c9f04c95","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:56.609Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-5b8d12bdbc7eaaff37c45e6b: start","job_status":"start","queue_duration_s":0.049853,"scheduling_latency_s":0.049865}1951gitlab # [ 242.526638] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:56.711Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"5b8d12bdbc7eaaff37c45e6b","created_at":"2026-11-07T12:12:56.606Z","trace_propagation_headers":{"sentry-trace":"985d1e954b1947118eb8b705ca104892-0800f9a9c9f04c95","baggage":"sentry-trace_id=985d1e954b1947118eb8b705ca104892,sentry-release=Unknown"},"correlation_id":"01M6TYRNC48F065SK7ZGAYKNVP","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:56.609Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-5b8d12bdbc7eaaff37c45e6b: done: 0.052202 sec","job_status":"done","queue_duration_s":0.049853,"scheduling_latency_s":0.049865,"redis_calls":11,"redis_duration_s":0.001596,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.0011,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000215669,"duration_s":0.052202,"completed_at":"2026-11-07T12:12:56.711Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012191,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1952gitlab # [ 242.606838] nixbot[2628]: {"ts": "2026-11-07T12:12:57.100Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1953gitlab # [ 242.608397] nixbot[2628]: {"ts": "2026-11-07T12:12:57.101Z", "level": "info", "logger": "nixbot.after_build", "msg": "reused build: replaying effect statuses", "build_id": 1, "sha": "356d7b11eb1d1152b4ae5590f7516adaa4143e15"}1954gitlab # [ 242.656259] gitaly[909]: time="2026-11-07T12:12:57.149Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT6CRTQ70NSANX8A218X0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:27.048" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:57.148" grpc.time_ms=0.405 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1955gitlab # [ 242.668435] gitaly[909]: time="2026-11-07T12:12:57.161Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT6CKKPC16VZR484QKJ9E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:57.142" grpc.time_ms=19.643 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1956gitlab # [ 242.669561] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:57 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 541957gitlab # [ 242.702257] gitaly[909]: time="2026-11-07T12:12:57.195Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT6CRTQ70NSANX8A218X0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:13:07.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:57.190" grpc.time_ms=5.145 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958gitlab # [ 242.732038] gitaly[909]: time="2026-11-07T12:12:57.225Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT6EJXX34M052QRF7N3NE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:57.216" pid=909 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1959gitlab # [ 242.741581] gitaly[909]: time="2026-11-07T12:12:57.225Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT6EJXX34M052QRF7N3NE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:57.216" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1960gitlab # [ 242.753958] gitlab-workhorse[825]: time="2026-11-07T12:12:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671961gitlab # [ 242.754869] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 591962gitlab # [ 242.755747] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.245Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"768564163ffc0fa937c0a6a3","created_at":"2026-11-07T12:12:57.240Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-eba7dac224cd4d24","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.243Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-768564163ffc0fa937c0a6a3: start","job_status":"start","queue_duration_s":0.001174,"scheduling_latency_s":0.001201}1963gitlab # [ 242.756763] gitaly[909]: time="2026-11-07T12:12:57.225Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT6EJXX34M052QRF7N3NE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:57.216" grpc.time_ms=8.945 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1964gitlab # [ 242.764256] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/356d7b11eb1d1152b4ae5590f7516adaa4143e15 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1441965gitlab # [ 242.806045] gitaly[909]: time="2026-11-07T12:12:57.299Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT6HF9TJE3HJPDZE16SV5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:27.198" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:57.298" grpc.time_ms=0.473 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1966gitlab # [ 242.845911] gitaly[909]: time="2026-11-07T12:12:57.339Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYT6CRTQ70NSANX8A218X0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:57.338" grpc.time_ms=0.288 pid=909 span.kind=server system=grpc1967gitlab # [ 242.854787] gitaly[909]: time="2026-11-07T12:12:57.348Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT6HF9TJE3HJPDZE16SV5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:13:07.163" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:57.343" grpc.time_ms=4.583 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1968gitlab # [ 242.867499] gitaly[909]: time="2026-11-07T12:12:57.361Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=9 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT6JNHS4KAY0YX335SCGN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:57.334" grpc.time_ms=26.494 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1969gitlab # [ 242.868807] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:57 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 601970gitlab # [ 242.883072] gitaly[909]: time="2026-11-07T12:12:57.375Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYT6CRTQ70NSANX8A218X0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:57.375" grpc.time_ms=0.386 pid=909 span.kind=server system=grpc1971gitlab # [ 242.901733] gitaly[909]: time="2026-11-07T12:12:57.395Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYT6CRTQ70NSANX8A218X0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:57.394" grpc.time_ms=0.325 pid=909 span.kind=server system=grpc1972gitlab # [ 242.910779] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/356d7b11eb1d1152b4ae5590f7516adaa4143e15 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1391973gitlab # [ 242.921306] gitaly[909]: time="2026-11-07T12:12:57.414Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT6CRTQ70NSANX8A218X0 diskcache=b6ba23e0-c7e0-49fb-84aa-90260aec4346 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-11-07T12:13:27.319" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:57.319" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1974gitlab # [ 242.922204] gitaly[909]: time="2026-11-07T12:12:57.415Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=71 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7167 command.oublock=0 command.real_time_ms=88 command.spawn_token_fork_ms=0 command.system_time_ms=43 command.user_time_ms=28 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT6CRTQ70NSANX8A218X0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-11-07T12:13:27.319" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:57.319" grpc.time_ms=95.363 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1975gitlab # [ 242.946037] gitaly[909]: time="2026-11-07T12:12:57.439Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT6P0ZF4M6KW691HF7ZEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:27.338" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:57.438" grpc.time_ms=0.356 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1976gitlab # [ 242.958169] gitaly[909]: time="2026-11-07T12:12:57.451Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT6MMEJ9CMQGYPXW2WBDN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:57.409" pid=909 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc1977gitlab # [ 242.958988] gitaly[909]: time="2026-11-07T12:12:57.451Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=34 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1164 command.oublock=0 command.real_time_ms=41 command.spawn_token_fork_ms=0 command.system_time_ms=18 command.user_time_ms=16 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT6MMEJ9CMQGYPXW2WBDN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:57.409" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1978gitlab # [ 242.959730] gitlab-workhorse[825]: time="2026-11-07T12:12:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161979gitlab # [ 242.960162] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 871980gitlab # [ 242.960656] gitaly[909]: time="2026-11-07T12:12:57.451Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=34 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1164 command.oublock=0 command.real_time_ms=41 command.spawn_token_fork_ms=0 command.system_time_ms=18 command.user_time_ms=16 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT6MMEJ9CMQGYPXW2WBDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:57.409" grpc.time_ms=42.609 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc1981gitlab # [ 242.962831] gitaly[909]: time="2026-11-07T12:12:57.456Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT6CRTQ70NSANX8A218X0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-11-07T12:13:27.455" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:57.455" grpc.time_ms=0.523 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1982gitlab # [ 242.984542] gitaly[909]: time="2026-11-07T12:12:57.478Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT6CRTQ70NSANX8A218X0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:27.477" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:57.477" grpc.time_ms=0.423 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1983gitlab # [ 243.016881] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.510Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b25dca120bf9a42578e872fe","created_at":"2026-11-07T12:12:57.508Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"768564163ffc0fa937c0a6a3","job_size_bytes":3,"pid":2500,"job_status":"deduplicated","message":"PipelineProcessWorker JID-b25dca120bf9a42578e872fe: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1984gitlab # [ 243.018327] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.511Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"768564163ffc0fa937c0a6a3","created_at":"2026-11-07T12:12:57.240Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-eba7dac224cd4d24","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.243Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2500,"job_status":"rescheduled","message":"PipelineProcessWorker JID-768564163ffc0fa937c0a6a3: rescheduled"}1985gitlab # [ 243.022938] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.516Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"768564163ffc0fa937c0a6a3","created_at":"2026-11-07T12:12:57.240Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-eba7dac224cd4d24","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.243Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-768564163ffc0fa937c0a6a3: done: 0.271264 sec","job_status":"done","queue_duration_s":0.001174,"scheduling_latency_s":0.001201,"gitaly_calls":3,"gitaly_duration_s":0.106587,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.015458,"redis_read_bytes":226,"redis_write_bytes":18468,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.00072,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001124,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.004738,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12314,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.004701,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000183,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000338,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002934,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":18,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117352,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.205096737,"duration_s":0.271264,"completed_at":"2026-11-07T12:12:57.516Z","load_balancing_strategy":"primary","db_duration_s":0.035788,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1986gitlab # [ 243.076799] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.517Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"0a0321b3bcf2ec1eb06a8e69","created_at":"2026-11-07T12:12:57.310Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.312Z","job_size_bytes":23,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-0a0321b3bcf2ec1eb06a8e69: start","job_status":"start","queue_duration_s":0.20494,"scheduling_latency_s":0.204956}1987gitlab # [ 243.077579] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.544Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"0a0321b3bcf2ec1eb06a8e69","created_at":"2026-11-07T12:12:57.310Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.312Z","job_size_bytes":23,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-0a0321b3bcf2ec1eb06a8e69: done: 0.027424 sec","job_status":"done","queue_duration_s":0.20494,"scheduling_latency_s":0.204956,"redis_calls":7,"redis_duration_s":0.000915,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000671,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027424,"completed_at":"2026-11-07T12:12:57.544Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007099,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1988gitlab # [ 243.118099] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.545Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"52616c5b12a71c9d5351e889","created_at":"2026-11-07T12:12:57.419Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.421Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-52616c5b12a71c9d5351e889: start","job_status":"start","queue_duration_s":0.124291,"scheduling_latency_s":0.124328}1989gitlab # [ 243.118735] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.561Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"52616c5b12a71c9d5351e889","created_at":"2026-11-07T12:12:57.419Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.421Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-52616c5b12a71c9d5351e889: done: 0.015784 sec","job_status":"done","queue_duration_s":0.124291,"scheduling_latency_s":0.124328,"redis_calls":7,"redis_duration_s":0.000933,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015784,"completed_at":"2026-11-07T12:12:57.561Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002461,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1990gitlab # [ 243.182287] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.562Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"5ee454a8fd6d623fdad60008","created_at":"2026-11-07T12:12:57.426Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.427Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-5ee454a8fd6d623fdad60008: start","job_status":"start","queue_duration_s":0.134605,"scheduling_latency_s":0.134619}1991gitlab # [ 243.183064] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.581Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"5ee454a8fd6d623fdad60008","created_at":"2026-11-07T12:12:57.426Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.427Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-5ee454a8fd6d623fdad60008: done: 0.019141 sec","job_status":"done","queue_duration_s":0.134605,"scheduling_latency_s":0.134619,"redis_calls":7,"redis_duration_s":0.000897,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000658,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019141,"completed_at":"2026-11-07T12:12:57.581Z","load_balancing_strategy":"primary","db_duration_s":0.005648,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1992gitlab # [ 243.225119] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.582Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9da24b6eb735927bd3c7d099","created_at":"2026-11-07T12:12:57.432Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.433Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9da24b6eb735927bd3c7d099: start","job_status":"start","queue_duration_s":0.14831,"scheduling_latency_s":0.148323}1993gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686'1994gitlab # [ 243.225745] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.599Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9da24b6eb735927bd3c7d099","created_at":"2026-11-07T12:12:57.432Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.433Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9da24b6eb735927bd3c7d099: done: 0.017435 sec","job_status":"done","queue_duration_s":0.14831,"scheduling_latency_s":0.148323,"redis_calls":10,"redis_duration_s":0.001425,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000659,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000526,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017435,"completed_at":"2026-11-07T12:12:57.599Z","load_balancing_strategy":"primary","db_duration_s":0.002577,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1995gitlab # [ 243.267051] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.600Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"2ecc2364645148e72c5570b5","created_at":"2026-11-07T12:12:57.434Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.435Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-2ecc2364645148e72c5570b5: start","job_status":"start","queue_duration_s":0.165188,"scheduling_latency_s":0.165201}1996gitlab # [ 243.304802] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.615Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"2ecc2364645148e72c5570b5","created_at":"2026-11-07T12:12:57.434Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.435Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-2ecc2364645148e72c5570b5: done: 0.015106 sec","job_status":"done","queue_duration_s":0.165188,"scheduling_latency_s":0.165201,"redis_calls":7,"redis_duration_s":0.001063,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015106,"completed_at":"2026-11-07T12:12:57.615Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002224,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1997gitlab # [ 243.307883] gitaly[909]: time="2026-11-07T12:12:57.738Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT6CRTQ70NSANX8A218X0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-11-07T12:13:27.737" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:57.737" grpc.time_ms=0.505 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1998gitlab # [ 243.319147] nixbot[2628]: {"ts": "2026-11-07T12:12:57.794Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:34914 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 HTTP/1.1\" 200"}1999gitlab # [ 243.321518] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.616Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f96d3a9d04ff4859c8a663a1","created_at":"2026-11-07T12:12:57.437Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.440Z","job_size_bytes":19,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f96d3a9d04ff4859c8a663a1: start","job_status":"start","queue_duration_s":0.176403,"scheduling_latency_s":0.176417}2000gitlab # [ 243.366743] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.631Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f96d3a9d04ff4859c8a663a1","created_at":"2026-11-07T12:12:57.437Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.440Z","job_size_bytes":19,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f96d3a9d04ff4859c8a663a1: done: 0.014379 sec","job_status":"done","queue_duration_s":0.176403,"scheduling_latency_s":0.176417,"redis_calls":8,"redis_duration_s":0.0010500000000000002,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000777,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014379,"completed_at":"2026-11-07T12:12:57.631Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002217,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2001gitlab # [ 243.373624] gitaly[909]: time="2026-11-07T12:12:57.756Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT6CRTQ70NSANX8A218X0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:27.755" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:57.755" grpc.time_ms=0.349 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2002gitlab # [ 243.384736] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.632Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a0899f4d815f89f27b399c82","created_at":"2026-11-07T12:12:57.441Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.442Z","job_size_bytes":66,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a0899f4d815f89f27b399c82: start","job_status":"start","queue_duration_s":0.189884,"scheduling_latency_s":0.189898}2003gitlab # [ 243.399875] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.645Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a0899f4d815f89f27b399c82","created_at":"2026-11-07T12:12:57.441Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.442Z","job_size_bytes":66,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a0899f4d815f89f27b399c82: done: 0.013271 sec","job_status":"done","queue_duration_s":0.189884,"scheduling_latency_s":0.189898,"redis_calls":7,"redis_duration_s":0.0008929999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013271,"completed_at":"2026-11-07T12:12:57.645Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001662,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2004gitlab # [ 243.438851] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.646Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"53d8fc0cc1a4a00353995bed","created_at":"2026-11-07T12:12:57.442Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.443Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-53d8fc0cc1a4a00353995bed: start","job_status":"start","queue_duration_s":0.202672,"scheduling_latency_s":0.202685}2005gitlab # [ 243.452581] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.662Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"53d8fc0cc1a4a00353995bed","created_at":"2026-11-07T12:12:57.442Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.443Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-53d8fc0cc1a4a00353995bed: done: 0.015622 sec","job_status":"done","queue_duration_s":0.202672,"scheduling_latency_s":0.202685,"redis_calls":7,"redis_duration_s":0.000857,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000619,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015622,"completed_at":"2026-11-07T12:12:57.662Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003644,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2006gitlab # [ 243.503171] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.663Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0b42d48f95e3b0230e7ced2f","created_at":"2026-11-07T12:12:57.444Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.445Z","job_size_bytes":6,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0b42d48f95e3b0230e7ced2f: start","job_status":"start","queue_duration_s":0.21798,"scheduling_latency_s":0.217993}2007gitlab # [ 243.504143] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.671Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0b42d48f95e3b0230e7ced2f","created_at":"2026-11-07T12:12:57.444Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.445Z","job_size_bytes":6,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0b42d48f95e3b0230e7ced2f: done: 0.008316 sec","job_status":"done","queue_duration_s":0.21798,"scheduling_latency_s":0.217993,"redis_calls":7,"redis_duration_s":0.000959,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008316,"completed_at":"2026-11-07T12:12:57.671Z","load_balancing_strategy":"primary","db_duration_s":0.000239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2008gitlab # [ 243.556656] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.672Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"dfc1c6668f410a40752775fc","created_at":"2026-11-07T12:12:57.445Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.446Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-dfc1c6668f410a40752775fc: start","job_status":"start","queue_duration_s":0.225874,"scheduling_latency_s":0.225887}2009gitlab # [ 243.557602] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.687Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"dfc1c6668f410a40752775fc","created_at":"2026-11-07T12:12:57.445Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.446Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-dfc1c6668f410a40752775fc: done: 0.01526 sec","job_status":"done","queue_duration_s":0.225874,"scheduling_latency_s":0.225887,"redis_calls":7,"redis_duration_s":0.000918,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000631,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01526,"completed_at":"2026-11-07T12:12:57.687Z","load_balancing_strategy":"primary","db_duration_s":0.003913,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2010gitlab # [ 243.598092] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.688Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"50dc56d9faab71e00e666ceb","created_at":"2026-11-07T12:12:57.511Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.513Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-50dc56d9faab71e00e666ceb: start","job_status":"start","queue_duration_s":0.175178,"scheduling_latency_s":0.175191}2011gitlab # [ 243.637601] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.763Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"50dc56d9faab71e00e666ceb","created_at":"2026-11-07T12:12:57.511Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-7d9a454ebda04de7","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.513Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-50dc56d9faab71e00e666ceb: done: 0.075067 sec","job_status":"done","queue_duration_s":0.175178,"scheduling_latency_s":0.175191,"gitaly_calls":2,"gitaly_duration_s":0.003727,"redis_calls":31,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.003488,"redis_read_bytes":55,"redis_write_bytes":4923,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000604,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000368,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_queues_calls":2,"redis_queues_duration_s":0.00017,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000132,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000123,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000585,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050034,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.056379791,"duration_s":0.075067,"completed_at":"2026-11-07T12:12:57.763Z","load_balancing_strategy":"primary","db_duration_s":0.020052,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2012gitlab # [ 243.678605] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.764Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"a28912c9613f0e976a0868d6","created_at":"2026-11-07T12:12:57.728Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-edd6563af3e24970","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.729Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a28912c9613f0e976a0868d6: start","job_status":"start","queue_duration_s":0.03503,"scheduling_latency_s":0.035045}2013gitlab # [ 243.679237] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:57.785Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"a28912c9613f0e976a0868d6","created_at":"2026-11-07T12:12:57.728Z","trace_propagation_headers":{"sentry-trace":"ae91d03c620840d79ed31cf353c0016e-edd6563af3e24970","baggage":"sentry-trace_id=ae91d03c620840d79ed31cf353c0016e,sentry-release=Unknown"},"correlation_id":"01M6TYT6CRTQ70NSANX8A218X0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:57.729Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a28912c9613f0e976a0868d6: done: 0.020763 sec","job_status":"done","queue_duration_s":0.03503,"scheduling_latency_s":0.035045,"redis_calls":7,"redis_duration_s":0.0009159999999999999,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000665,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020763,"completed_at":"2026-11-07T12:12:57.785Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003496,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2014gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686', in 0.49 seconds)2015gitlab # [ 243.752621] gitaly[909]: time="2026-11-07T12:12:58.246Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT6P0ZF4M6KW691HF7ZEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:13:08.140" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:58.240" grpc.time_ms=5.331 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2016gitlab # [ 243.780845] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.274Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"3a45ffdd8fe406ed4cc84996","created_at":"2026-11-07T12:12:58.269Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-fac2f916d61144ae","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.272Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3a45ffdd8fe406ed4cc84996: start","job_status":"start","queue_duration_s":0.00207,"scheduling_latency_s":0.002098}2017gitlab # [ 243.796070] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:58 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/356d7b11eb1d1152b4ae5590f7516adaa4143e15 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 8752018gitlab # [ 243.806456] gitaly[909]: time="2026-11-07T12:12:58.299Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT7GQEKYCX9WE1802TVEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:28.198" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:58.299" grpc.time_ms=0.464 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2019gitlab # [ 243.829808] gitaly[909]: time="2026-11-07T12:12:58.323Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT7GQEKYCX9WE1802TVEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-11-07T12:13:28.215" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:58.315" grpc.time_ms=7.807 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2020gitlab # [ 243.838960] gitaly[909]: time="2026-11-07T12:12:58.332Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT7GQEKYCX9WE1802TVEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:13:08.147" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:58.327" grpc.time_ms=4.617 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2021gitlab # [ 243.867302] gitaly[909]: time="2026-11-07T12:12:58.360Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT7GQEKYCX9WE1802TVEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-11-07T12:13:08.180" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:58.360" grpc.time_ms=0.152 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2022gitlab # [ 243.877223] gitaly[909]: time="2026-11-07T12:12:58.367Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT7J50F43NPDGKTWTFSJM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:58.359" grpc.time_ms=7.024 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc2023gitlab # [ 243.888959] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 572024gitlab # [ 243.891051] gitaly[909]: time="2026-11-07T12:12:58.376Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=619 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT7GQEKYCX9WE1802TVEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-11-07T12:13:08.185" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:58.365" grpc.time_ms=10.797 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2025gitlab # [ 243.903690] gitaly[909]: time="2026-11-07T12:12:58.394Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYT6P0ZF4M6KW691HF7ZEJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:58.394" grpc.time_ms=0.312 pid=909 span.kind=server system=grpc2026gitlab # [ 243.916630] gitaly[909]: time="2026-11-07T12:12:58.410Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT7M003EF5K2KKCACPRZM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:58.403" pid=909 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2027gitlab # [ 243.925695] gitaly[909]: time="2026-11-07T12:12:58.410Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT7M003EF5K2KKCACPRZM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:58.403" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc2028gitlab # [ 243.937788] gitlab-workhorse[825]: time="2026-11-07T12:12:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672029gitlab # [ 243.939697] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 422030gitlab # [ 243.941474] gitaly[909]: time="2026-11-07T12:12:58.410Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT7M003EF5K2KKCACPRZM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:58.403" grpc.time_ms=7.054 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc2031gitlab # [ 243.954315] gitaly[909]: time="2026-11-07T12:12:58.420Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYT7GQEKYCX9WE1802TVEJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:58.420" grpc.time_ms=0.479 pid=909 span.kind=server system=grpc2032gitlab # [ 243.962929] gitaly[909]: time="2026-11-07T12:12:58.426Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYT6P0ZF4M6KW691HF7ZEJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:58.425" grpc.time_ms=0.417 pid=909 span.kind=server system=grpc2033gitlab # [ 243.973356] gitaly[909]: time="2026-11-07T12:12:58.452Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYT7GQEKYCX9WE1802TVEJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:58.452" grpc.time_ms=0.295 pid=909 span.kind=server system=grpc2034gitlab # [ 243.974076] gitaly[909]: time="2026-11-07T12:12:58.457Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYT6P0ZF4M6KW691HF7ZEJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:12:58.456" grpc.time_ms=0.794 pid=909 span.kind=server system=grpc2035gitlab # [ 243.974848] gitaly[909]: time="2026-11-07T12:12:58.464Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT7GQEKYCX9WE1802TVEJ forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-11-07T12:13:08.198" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:58.378" operations="[repack_refs]" pid=909 ref=refs/keep-around/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 remote_ip="2001:db8:1::1" revision=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 span.kind=server system=grpc username=root2036gitlab # [ 243.975298] gitaly[909]: time="2026-11-07T12:12:58.465Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT7GQEKYCX9WE1802TVEJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-11-07T12:13:08.198" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:58.378" pid=909 ref=refs/keep-around/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-11-07 12:12:00.541654156 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" revision=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 span.kind=server system=grpc username=root2037gitlab # [ 243.975856] gitaly[909]: time="2026-11-07T12:12:58.468Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT6P0ZF4M6KW691HF7ZEJ diskcache=18fbcc71-9d43-44b2-b546-4aec291e5ddf grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-11-07T12:13:28.372" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:58.373" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2038gitlab # [ 243.982281] gitaly[909]: time="2026-11-07T12:12:58.469Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=59 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7125 command.oublock=0 command.real_time_ms=86 command.spawn_token_fork_ms=2 command.system_time_ms=45 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT6P0ZF4M6KW691HF7ZEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-11-07T12:13:28.372" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:12:58.373" grpc.time_ms=96.199 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2039gitlab # [ 244.026573] gitaly[909]: time="2026-11-07T12:12:58.477Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT7GQEKYCX9WE1802TVEJ diskcache=990a921a-922b-471a-a5d9-365f6d394936 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-11-07T12:13:08.198" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:58.378" pid=909 ref=refs/keep-around/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 remote_ip="2001:db8:1::1" revision=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 span.kind=server system=grpc username=root2040gitlab # [ 244.027401] gitaly[909]: time="2026-11-07T12:12:58.477Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=42 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5337 command.oublock=8 command.real_time_ms=84 command.spawn_token_fork_ms=0 command.system_time_ms=27 command.user_time_ms=15 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT7GQEKYCX9WE1802TVEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-11-07T12:13:08.198" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:58.378" grpc.time_ms=98.934 pid=909 ref=refs/keep-around/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 remote_ip="2001:db8:1::1" revision=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 span.kind=server system=grpc username=root2041gitlab # [ 244.028087] gitaly[909]: time="2026-11-07T12:12:58.481Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT7GQEKYCX9WE1802TVEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:28.380" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:58.480" grpc.time_ms=1.085 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2042gitlab # [ 244.063985] gitaly[909]: time="2026-11-07T12:12:58.556Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT7PA9ZQKM7Q0KS781B6B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:58.489" grpc.time_ms=67.006 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc2043gitlab # [ 244.067244] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1142044gitlab # [ 244.094245] gitaly[909]: time="2026-11-07T12:12:58.587Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT6P0ZF4M6KW691HF7ZEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-11-07T12:13:28.586" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:58.586" grpc.time_ms=0.687 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2045gitlab # [ 244.098901] gitaly[909]: time="2026-11-07T12:12:58.592Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT7GQEKYCX9WE1802TVEJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-11-07T12:13:08.198" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:58.378" pid=909 ref=refs/keep-around/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 remote_ip="2001:db8:1::1" revision=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2046gitlab # [ 244.099662] gitaly[909]: time="2026-11-07T12:12:58.592Z" level=info msg="optimized repository" clean_stale_data_time=126.401819ms clean_work_trees_time="68.724µs" commit_graph_time="3.911µs" correlation_id=01M6TYT7GQEKYCX9WE1802TVEJ gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.632µs" pid=909 prune_time="3.073µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="5.308µs" storage_name=default system=housekeeping total_time=126.594581ms2047gitlab # [ 244.100090] gitaly[909]: time="2026-11-07T12:12:58.592Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT7GQEKYCX9WE1802TVEJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-11-07T12:13:08.198" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-11-07T12:12:58.378" pid=909 ref=refs/keep-around/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 remote_ip="2001:db8:1::1" revision=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 span.kind=server system=grpc username=root2048gitlab # [ 244.126406] gitaly[909]: time="2026-11-07T12:12:58.619Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT6P0ZF4M6KW691HF7ZEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:28.618" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:58.619" grpc.time_ms=0.667 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2049gitlab # [ 244.136076] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.628Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"3a45ffdd8fe406ed4cc84996","created_at":"2026-11-07T12:12:58.269Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-fac2f916d61144ae","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.272Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3a45ffdd8fe406ed4cc84996: done: 0.354702 sec","job_status":"done","queue_duration_s":0.00207,"scheduling_latency_s":0.002098,"gitaly_calls":3,"gitaly_duration_s":0.113797,"redis_calls":71,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.021127,"redis_read_bytes":151,"redis_write_bytes":19872,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002381,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000577,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":23,"redis_queues_duration_s":0.006864,"redis_queues_read_bytes":25,"redis_queues_write_bytes":13374,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.006639,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3094,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000163,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000343,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001779,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.031,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.047,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.04,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.087567,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.328521363,"duration_s":0.354702,"completed_at":"2026-11-07T12:12:58.628Z","load_balancing_strategy":"primary","db_duration_s":0.069595,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2050gitlab # [ 244.150852] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.629Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e430cb04e812f7836efc3333","created_at":"2026-11-07T12:12:58.366Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.369Z","job_size_bytes":23,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e430cb04e812f7836efc3333: start","job_status":"start","queue_duration_s":0.260698,"scheduling_latency_s":0.260717}2051gitlab # [ 244.195666] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:58 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 3722052gitlab # [ 244.196501] nixbot[2628]: {"ts": "2026-11-07T12:12:58.649Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-e3f8e82aecb9-4"}2053gitlab # [ 244.197111] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.658Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e430cb04e812f7836efc3333","created_at":"2026-11-07T12:12:58.366Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.369Z","job_size_bytes":23,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e430cb04e812f7836efc3333: done: 0.029072 sec","job_status":"done","queue_duration_s":0.260698,"scheduling_latency_s":0.260717,"redis_calls":7,"redis_duration_s":0.000939,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000692,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029072,"completed_at":"2026-11-07T12:12:58.658Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006331,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2054gitlab # [ 244.241154] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.659Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4a350725acec87d714676a8f","created_at":"2026-11-07T12:12:58.479Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.485Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4a350725acec87d714676a8f: start","job_status":"start","queue_duration_s":0.174386,"scheduling_latency_s":0.174401}2055gitlab # [ 244.241840] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.676Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4a350725acec87d714676a8f","created_at":"2026-11-07T12:12:58.479Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.485Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4a350725acec87d714676a8f: done: 0.016932 sec","job_status":"done","queue_duration_s":0.174386,"scheduling_latency_s":0.174401,"redis_calls":7,"redis_duration_s":0.001018,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000679,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000339,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010433,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016932,"completed_at":"2026-11-07T12:12:58.676Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003656,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2056gitlab # [ 244.294619] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.677Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cfefa9f821003e261e16922e","created_at":"2026-11-07T12:12:58.549Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.551Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cfefa9f821003e261e16922e: start","job_status":"start","queue_duration_s":0.126062,"scheduling_latency_s":0.126076}2057gitlab # [ 244.295518] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.698Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cfefa9f821003e261e16922e","created_at":"2026-11-07T12:12:58.549Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.551Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cfefa9f821003e261e16922e: done: 0.02056 sec","job_status":"done","queue_duration_s":0.126062,"scheduling_latency_s":0.126076,"redis_calls":7,"redis_duration_s":0.000996,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02056,"completed_at":"2026-11-07T12:12:58.698Z","load_balancing_strategy":"primary","db_duration_s":0.007053,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2058gitlab # [ 244.311898] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.699Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d01cdc6aae11ee9a134893be","created_at":"2026-11-07T12:12:58.558Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.560Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d01cdc6aae11ee9a134893be: start","job_status":"start","queue_duration_s":0.138692,"scheduling_latency_s":0.138706}2059gitlab # [ 244.340097] nixbot[2628]: {"ts": "2026-11-07T12:12:58.756Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-e3f8e82aecb9-4", "argv0": "bwrap"}2060gitlab # [ 244.340790] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.716Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d01cdc6aae11ee9a134893be","created_at":"2026-11-07T12:12:58.558Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.560Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d01cdc6aae11ee9a134893be: done: 0.017576 sec","job_status":"done","queue_duration_s":0.138692,"scheduling_latency_s":0.138706,"redis_calls":10,"redis_duration_s":0.001247,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000365,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017576,"completed_at":"2026-11-07T12:12:58.716Z","load_balancing_strategy":"primary","db_duration_s":0.002937,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2061gitlab # [ 244.393846] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.717Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"cb329fcebef8e69bf8531219","created_at":"2026-11-07T12:12:58.560Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.562Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-cb329fcebef8e69bf8531219: start","job_status":"start","queue_duration_s":0.15552,"scheduling_latency_s":0.155534}2062gitlab # [ 244.394740] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.732Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"cb329fcebef8e69bf8531219","created_at":"2026-11-07T12:12:58.560Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.562Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-cb329fcebef8e69bf8531219: done: 0.014854 sec","job_status":"done","queue_duration_s":0.15552,"scheduling_latency_s":0.155534,"redis_calls":7,"redis_duration_s":0.00091,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000683,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000227,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014854,"completed_at":"2026-11-07T12:12:58.732Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002471,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2063gitlab # [ 244.449664] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.733Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"873993d10b12be96d294ffcc","created_at":"2026-11-07T12:12:58.563Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.565Z","job_size_bytes":19,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-873993d10b12be96d294ffcc: start","job_status":"start","queue_duration_s":0.167692,"scheduling_latency_s":0.167706}2064gitlab # [ 244.450553] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.748Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"873993d10b12be96d294ffcc","created_at":"2026-11-07T12:12:58.563Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.565Z","job_size_bytes":19,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-873993d10b12be96d294ffcc: done: 0.015457 sec","job_status":"done","queue_duration_s":0.167692,"scheduling_latency_s":0.167706,"redis_calls":8,"redis_duration_s":0.001013,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000784,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015457,"completed_at":"2026-11-07T12:12:58.748Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003818,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2065gitlab # [ 244.497807] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.749Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"90e19de44acfd3780a9b31a8","created_at":"2026-11-07T12:12:58.567Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.568Z","job_size_bytes":66,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-90e19de44acfd3780a9b31a8: start","job_status":"start","queue_duration_s":0.181444,"scheduling_latency_s":0.181457}2066gitlab # [ 244.498706] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.848Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"90e19de44acfd3780a9b31a8","created_at":"2026-11-07T12:12:58.567Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.568Z","job_size_bytes":66,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-90e19de44acfd3780a9b31a8: done: 0.099153 sec","job_status":"done","queue_duration_s":0.181444,"scheduling_latency_s":0.181457,"redis_calls":7,"redis_duration_s":0.075144,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.07213,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003014,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.099153,"completed_at":"2026-11-07T12:12:58.848Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007967,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2067gitlab # [ 244.540292] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.849Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"1aae5399a333d153928e382c","created_at":"2026-11-07T12:12:58.568Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.569Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-1aae5399a333d153928e382c: start","job_status":"start","queue_duration_s":0.280052,"scheduling_latency_s":0.280072}2068gitlab # [ 244.542168] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.869Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"1aae5399a333d153928e382c","created_at":"2026-11-07T12:12:58.568Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.569Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-1aae5399a333d153928e382c: done: 0.019776 sec","job_status":"done","queue_duration_s":0.280052,"scheduling_latency_s":0.280072,"redis_calls":7,"redis_duration_s":0.000897,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000643,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019776,"completed_at":"2026-11-07T12:12:58.869Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002862,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2069gitlab # [ 244.580668] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.870Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"636f002d77ff0378d6b32b56","created_at":"2026-11-07T12:12:58.572Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.573Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-636f002d77ff0378d6b32b56: start","job_status":"start","queue_duration_s":0.297077,"scheduling_latency_s":0.297091}2070gitlab # [ 244.619975] gitaly[909]: time="2026-11-07T12:12:59.006Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYT7GQEKYCX9WE1802TVEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-11-07T12:13:29.005" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:59.005" grpc.time_ms=0.636 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2071gitlab # [ 244.620815] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.885Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"636f002d77ff0378d6b32b56","created_at":"2026-11-07T12:12:58.572Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.573Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-636f002d77ff0378d6b32b56: done: 0.014949 sec","job_status":"done","queue_duration_s":0.297077,"scheduling_latency_s":0.297091,"redis_calls":7,"redis_duration_s":0.000873,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014949,"completed_at":"2026-11-07T12:12:58.885Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00333,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2072gitlab # [ 244.661141] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.886Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b63b1c3b2cffe217ed77a139","created_at":"2026-11-07T12:12:58.573Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.574Z","job_size_bytes":6,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b63b1c3b2cffe217ed77a139: start","job_status":"start","queue_duration_s":0.311361,"scheduling_latency_s":0.311374}2073gitlab # [ 244.661865] gitaly[909]: time="2026-11-07T12:12:59.026Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT7GQEKYCX9WE1802TVEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:29.025" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:59.025" grpc.time_ms=0.514 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2074gitlab # [ 244.701487] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.896Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b63b1c3b2cffe217ed77a139","created_at":"2026-11-07T12:12:58.573Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.574Z","job_size_bytes":6,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b63b1c3b2cffe217ed77a139: done: 0.009928 sec","job_status":"done","queue_duration_s":0.311361,"scheduling_latency_s":0.311374,"redis_calls":7,"redis_duration_s":0.000869,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000609,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009928,"completed_at":"2026-11-07T12:12:58.896Z","load_balancing_strategy":"primary","db_duration_s":0.002073,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2075gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686'2076gitlab # [ 244.705775] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.896Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"aabb7f5c54ebdcb7561e3f6a","created_at":"2026-11-07T12:12:58.575Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.576Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-aabb7f5c54ebdcb7561e3f6a: start","job_status":"start","queue_duration_s":0.320712,"scheduling_latency_s":0.320725}2077gitlab # [ 244.751660] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.910Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"aabb7f5c54ebdcb7561e3f6a","created_at":"2026-11-07T12:12:58.575Z","trace_propagation_headers":{"sentry-trace":"488f0a1c23d54444b4ab87f23e8934c9-f0603ba4484c4f86","baggage":"sentry-trace_id=488f0a1c23d54444b4ab87f23e8934c9,sentry-release=Unknown"},"correlation_id":"01M6TYT6P0ZF4M6KW691HF7ZEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.576Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-aabb7f5c54ebdcb7561e3f6a: done: 0.01343 sec","job_status":"done","queue_duration_s":0.320712,"scheduling_latency_s":0.320725,"redis_calls":7,"redis_duration_s":0.000847,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000603,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01343,"completed_at":"2026-11-07T12:12:58.910Z","load_balancing_strategy":"primary","db_duration_s":0.002369,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2078gitlab # [ 244.755885] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.911Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"fefc59da98454e18fa47e5f8","created_at":"2026-11-07T12:12:58.572Z","trace_propagation_headers":{"sentry-trace":"47fbaa76c70343698751441c9096ed7e-445c7f5d66ad4f06","baggage":"sentry-trace_id=47fbaa76c70343698751441c9096ed7e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYT7GQEKYCX9WE1802TVEJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.577Z","job_size_bytes":65,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-fefc59da98454e18fa47e5f8: start","job_status":"start","queue_duration_s":0.333865,"scheduling_latency_s":0.333877}2079gitlab # [ 244.807174] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.927Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"fefc59da98454e18fa47e5f8","created_at":"2026-11-07T12:12:58.572Z","trace_propagation_headers":{"sentry-trace":"47fbaa76c70343698751441c9096ed7e-445c7f5d66ad4f06","baggage":"sentry-trace_id=47fbaa76c70343698751441c9096ed7e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYT7GQEKYCX9WE1802TVEJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.577Z","job_size_bytes":65,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-fefc59da98454e18fa47e5f8: done: 0.016348 sec","job_status":"done","queue_duration_s":0.333865,"scheduling_latency_s":0.333877,"redis_calls":7,"redis_duration_s":0.0008680000000000001,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000613,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016348,"completed_at":"2026-11-07T12:12:58.927Z","load_balancing_strategy":"primary","db_duration_s":0.002813,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2080gitlab # [ 244.808205] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.928Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"40f99bc19620f3cc4878134d","created_at":"2026-11-07T12:12:58.578Z","trace_propagation_headers":{"sentry-trace":"47fbaa76c70343698751441c9096ed7e-445c7f5d66ad4f06","baggage":"sentry-trace_id=47fbaa76c70343698751441c9096ed7e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYT7GQEKYCX9WE1802TVEJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.581Z","job_size_bytes":65,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-40f99bc19620f3cc4878134d: start","job_status":"start","queue_duration_s":0.346982,"scheduling_latency_s":0.346995}2081gitlab # [ 244.848613] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.962Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"40f99bc19620f3cc4878134d","created_at":"2026-11-07T12:12:58.578Z","trace_propagation_headers":{"sentry-trace":"47fbaa76c70343698751441c9096ed7e-445c7f5d66ad4f06","baggage":"sentry-trace_id=47fbaa76c70343698751441c9096ed7e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYT7GQEKYCX9WE1802TVEJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.581Z","job_size_bytes":65,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-40f99bc19620f3cc4878134d: done: 0.034209 sec","job_status":"done","queue_duration_s":0.346982,"scheduling_latency_s":0.346995,"redis_calls":10,"redis_duration_s":0.001358,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.00063,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034209,"completed_at":"2026-11-07T12:12:58.962Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011495,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2082gitlab # [ 244.887667] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:58.963Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"48c5390066a89053f4d87979","created_at":"2026-11-07T12:12:58.617Z","trace_propagation_headers":{"sentry-trace":"47fbaa76c70343698751441c9096ed7e-445c7f5d66ad4f06","baggage":"sentry-trace_id=47fbaa76c70343698751441c9096ed7e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYT7GQEKYCX9WE1802TVEJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.618Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-48c5390066a89053f4d87979: start","job_status":"start","queue_duration_s":0.34446,"scheduling_latency_s":0.344475}2083gitlab # [ 244.888639] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:59.032Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"48c5390066a89053f4d87979","created_at":"2026-11-07T12:12:58.617Z","trace_propagation_headers":{"sentry-trace":"47fbaa76c70343698751441c9096ed7e-445c7f5d66ad4f06","baggage":"sentry-trace_id=47fbaa76c70343698751441c9096ed7e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYT7GQEKYCX9WE1802TVEJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.618Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-48c5390066a89053f4d87979: done: 0.069411 sec","job_status":"done","queue_duration_s":0.34446,"scheduling_latency_s":0.344475,"gitaly_calls":2,"gitaly_duration_s":0.003973,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.0037259999999999997,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000579,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000556,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000191,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000151,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000254,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000521,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049326,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.052455829,"duration_s":0.069411,"completed_at":"2026-11-07T12:12:59.032Z","load_balancing_strategy":"primary","db_duration_s":0.015759,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2084gitlab # [ 244.941156] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:59.033Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"2d3522d9959dcab90850e17a","created_at":"2026-11-07T12:12:58.996Z","trace_propagation_headers":{"sentry-trace":"47fbaa76c70343698751441c9096ed7e-758533d89b964740","baggage":"sentry-trace_id=47fbaa76c70343698751441c9096ed7e,sentry-release=Unknown"},"correlation_id":"01M6TYT7GQEKYCX9WE1802TVEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.997Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2d3522d9959dcab90850e17a: start","job_status":"start","queue_duration_s":0.036645,"scheduling_latency_s":0.036659}2085gitlab # [ 244.941892] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:12:59.055Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"2d3522d9959dcab90850e17a","created_at":"2026-11-07T12:12:58.996Z","trace_propagation_headers":{"sentry-trace":"47fbaa76c70343698751441c9096ed7e-758533d89b964740","baggage":"sentry-trace_id=47fbaa76c70343698751441c9096ed7e,sentry-release=Unknown"},"correlation_id":"01M6TYT7GQEKYCX9WE1802TVEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-11-07T12:12:58.997Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2d3522d9959dcab90850e17a: done: 0.021339 sec","job_status":"done","queue_duration_s":0.036645,"scheduling_latency_s":0.036659,"redis_calls":7,"redis_duration_s":0.0008860000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000638,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021339,"completed_at":"2026-11-07T12:12:59.055Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004562,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2086gitlab # [ 245.025391] nixbot[2628]: {"ts": "2026-11-07T12:12:59.518Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:34918 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 HTTP/1.1\" 200"}2087gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e3f8e82aecb9f4e4ea270ab48ee1a63907feb686', in 0.28 seconds)2088(finished: subtest: push delivers the webhook, in 48.22 seconds)2089subtest: eval and build post commit statuses2090gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses2091gitlab # [ 245.065405] nix-daemon[2787]: accepted connection from pid 3630, user nixbot2092gitlab # [ 245.093224] gitaly[909]: time="2026-11-07T12:12:59.586Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT8RS15GQ0MCBS6V1CQF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:29.485" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:12:59.586" grpc.time_ms=0.471 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2093gitlab # [ 245.111658] gitaly[909]: time="2026-11-07T12:12:59.605Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT7SZ3S5HZT4KMF0VM2NK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:59.598" pid=909 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2094gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses, in 0.09 seconds)2095gitlab # [ 245.121394] gitaly[909]: time="2026-11-07T12:12:59.605Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT7SZ3S5HZT4KMF0VM2NK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:59.598" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc2096gitlab # [ 245.122349] gitlab-workhorse[825]: time="2026-11-07T12:12:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672097gitlab # [ 245.122848] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 10462098gitlab # [ 245.123558] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:12:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 622099gitlab # [ 245.124255] gitaly[909]: time="2026-11-07T12:12:59.605Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT7SZ3S5HZT4KMF0VM2NK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:12:59.598" grpc.time_ms=6.996 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc2100gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses2101gitlab # [ 246.276939] gitaly[909]: time="2026-11-07T12:13:00.769Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYT9VBGY8HJB2FXA6TBW0G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:30.667" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:13:00.768" grpc.time_ms=0.974 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2102gitlab # [ 246.318465] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:13:00 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1592103gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses, in 0.20 seconds)2104gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses2105gitlab # [ 247.419655] gitaly[909]: time="2026-11-07T12:13:01.912Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYTB0WWRH4AS4NDDRBWG9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:31.210" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:13:01.911" grpc.time_ms=0.988 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2106gitlab # [ 247.456419] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:13:01 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 952107gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses, in 0.14 seconds)2108gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses2109gitlab # [ 248.553402] gitaly[909]: time="2026-11-07T12:13:03.046Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYTC4E8J5A04NZ937T0Z10 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:33.044" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:13:03.044" grpc.time_ms=0.829 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2110gitlab # [ 248.588960] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:13:03 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 902111gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses, in 0.13 seconds)2112gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses2113gitlab # [ 249.690784] gitaly[909]: time="2026-11-07T12:13:04.183Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYTD7VK58Y5B05S2REHRCX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:34.081" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:13:04.182" grpc.time_ms=0.909 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 249.751823] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:13:04 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1202115gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses, in 0.16 seconds)2116gitlab # [ 250.053928] nix-daemon[2787]: accepted connection from pid 3687, user nixbot2117gitlab # [ 250.066867] nix-daemon[2787]: accepted connection from pid 3630, user nixbot2118gitlab # [ 250.160292] gitaly[909]: time="2026-11-07T12:13:04.653Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYTDPQD87TMFFG1TZQGBTY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:34.552" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:13:04.652" grpc.time_ms=0.795 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2119gitlab # [ 250.215518] gitaly[909]: time="2026-11-07T12:13:04.708Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYTDPQD87TMFFG1TZQGBTY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:13:14.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:13:04.698" grpc.time_ms=10.672 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2120gitlab # [ 250.281774] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:04.774Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5f84280050490b1f3035335f","created_at":"2026-11-07T12:13:04.768Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-e8451a28b4f34023","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:04.772Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5f84280050490b1f3035335f: start","job_status":"start","queue_duration_s":0.001867,"scheduling_latency_s":0.001915}2121gitlab # [ 250.314661] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:13:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1872122gitlab # [ 250.341135] gitaly[909]: time="2026-11-07T12:13:04.834Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYTDWVD0T7JCPW5CSMZGXC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:34.132" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:13:04.833" grpc.time_ms=0.894 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab # [ 250.402170] gitaly[909]: time="2026-11-07T12:13:04.895Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M6TYTDWVD0T7JCPW5CSMZGXC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:13:14.158" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:13:04.889" grpc.time_ms=6.05 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124gitlab # [ 250.408360] gitaly[909]: time="2026-11-07T12:13:04.901Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYTDPQD87TMFFG1TZQGBTY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:13:04.901" grpc.time_ms=0.426 pid=909 span.kind=server system=grpc2125gitlab # [ 250.438132] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:13:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1352126gitlab # [ 250.454982] gitaly[909]: time="2026-11-07T12:13:04.948Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYTDPQD87TMFFG1TZQGBTY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:13:04.947" grpc.time_ms=0.452 pid=909 span.kind=server system=grpc2127gitlab # [ 250.483553] gitaly[909]: time="2026-11-07T12:13:04.976Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYTDPQD87TMFFG1TZQGBTY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:13:04.975" grpc.time_ms=1.207 pid=909 span.kind=server system=grpc2128gitlab # [ 250.498676] gitaly[909]: time="2026-11-07T12:13:04.992Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYTE1J588QWAR5YKJPZYWR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:34.291" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:13:04.991" grpc.time_ms=0.447 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab # [ 250.500912] gitaly[909]: time="2026-11-07T12:13:04.994Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYTDPQD87TMFFG1TZQGBTY diskcache=8fe89cb2-0b4e-4a7e-bd8b-8eda6d50277d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-11-07T12:13:34.861" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:13:04.862" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2130gitlab # [ 250.501673] gitaly[909]: time="2026-11-07T12:13:04.994Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=95 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7323 command.oublock=0 command.real_time_ms=125 command.spawn_token_fork_ms=0 command.system_time_ms=55 command.user_time_ms=40 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYTDPQD87TMFFG1TZQGBTY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-11-07T12:13:34.861" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:13:04.862" grpc.time_ms=132.442 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2131gitlab # [ 250.568161] gitaly[909]: time="2026-11-07T12:13:05.061Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M6TYTE1J588QWAR5YKJPZYWR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-11-07T12:13:15.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:13:05.053" grpc.time_ms=8.089 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2132gitlab # [ 250.575400] gitaly[909]: time="2026-11-07T12:13:05.068Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYTDPQD87TMFFG1TZQGBTY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-11-07T12:13:35.067" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:13:05.068" grpc.time_ms=0.634 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2133gitlab # [ 250.595102] gitaly[909]: time="2026-11-07T12:13:05.088Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYTDPQD87TMFFG1TZQGBTY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:35.087" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:13:05.087" grpc.time_ms=0.539 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2134gitlab # [ 250.602343] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.095Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a2d5d13e861ddc108527776a","created_at":"2026-11-07T12:13:05.094Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"5f84280050490b1f3035335f","job_size_bytes":3,"pid":2500,"job_status":"deduplicated","message":"PipelineProcessWorker JID-a2d5d13e861ddc108527776a: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2135gitlab # [ 250.603350] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.096Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5f84280050490b1f3035335f","created_at":"2026-11-07T12:13:04.768Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-e8451a28b4f34023","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:04.772Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2500,"job_status":"rescheduled","message":"PipelineProcessWorker JID-5f84280050490b1f3035335f: rescheduled"}2136gitlab # [ 250.607447] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.100Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5f84280050490b1f3035335f","created_at":"2026-11-07T12:13:04.768Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-e8451a28b4f34023","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:04.772Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5f84280050490b1f3035335f: done: 0.326866 sec","job_status":"done","queue_duration_s":0.001867,"scheduling_latency_s":0.001915,"gitaly_calls":3,"gitaly_duration_s":0.168809,"redis_calls":80,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.013377,"redis_read_bytes":240,"redis_write_bytes":21868,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001313,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000942,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.002795,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14468,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.004174,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000438,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000627,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001775,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.114165,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.281526283,"duration_s":0.326866,"completed_at":"2026-11-07T12:13:05.100Z","load_balancing_strategy":"primary","db_duration_s":0.033562,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2137gitlab # [ 250.673255] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.101Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"cc6bf5e81d9533c815a0f035","created_at":"2026-11-07T12:13:04.856Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:04.857Z","job_size_bytes":23,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-cc6bf5e81d9533c815a0f035: start","job_status":"start","queue_duration_s":0.243934,"scheduling_latency_s":0.243948}2138gitlab # [ 250.673912] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.125Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"cc6bf5e81d9533c815a0f035","created_at":"2026-11-07T12:13:04.856Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:04.857Z","job_size_bytes":23,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-cc6bf5e81d9533c815a0f035: done: 0.024174 sec","job_status":"done","queue_duration_s":0.243934,"scheduling_latency_s":0.243948,"redis_calls":7,"redis_duration_s":0.000918,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000233,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024174,"completed_at":"2026-11-07T12:13:05.125Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00453,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2139gitlab # [ 250.715911] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.126Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e6e76f84d1517c63d331faa9","created_at":"2026-11-07T12:13:05.027Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.029Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e6e76f84d1517c63d331faa9: start","job_status":"start","queue_duration_s":0.097001,"scheduling_latency_s":0.097014}2140gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses2141gitlab # [ 250.716576] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.143Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e6e76f84d1517c63d331faa9","created_at":"2026-11-07T12:13:05.027Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.029Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e6e76f84d1517c63d331faa9: done: 0.016829 sec","job_status":"done","queue_duration_s":0.097001,"scheduling_latency_s":0.097014,"redis_calls":7,"redis_duration_s":0.001078,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000774,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000304,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016829,"completed_at":"2026-11-07T12:13:05.143Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003751,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2142gitlab # [ 250.746747] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.144Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"76e4cea827a87e01fa1d5209","created_at":"2026-11-07T12:13:05.034Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.038Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-76e4cea827a87e01fa1d5209: start","job_status":"start","queue_duration_s":0.106336,"scheduling_latency_s":0.106349}2143gitlab # [ 250.796783] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.161Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"76e4cea827a87e01fa1d5209","created_at":"2026-11-07T12:13:05.034Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.038Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-76e4cea827a87e01fa1d5209: done: 0.016855 sec","job_status":"done","queue_duration_s":0.106336,"scheduling_latency_s":0.106349,"redis_calls":7,"redis_duration_s":0.00134,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000389,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016855,"completed_at":"2026-11-07T12:13:05.161Z","load_balancing_strategy":"primary","db_duration_s":0.003128,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2144gitlab # [ 250.797966] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.162Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"e8b3f9c4bb431aa8cbf12294","created_at":"2026-11-07T12:13:05.045Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.046Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e8b3f9c4bb431aa8cbf12294: start","job_status":"start","queue_duration_s":0.116127,"scheduling_latency_s":0.116141}2145gitlab # [ 250.811970] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.183Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"e8b3f9c4bb431aa8cbf12294","created_at":"2026-11-07T12:13:05.045Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.046Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e8b3f9c4bb431aa8cbf12294: done: 0.021357 sec","job_status":"done","queue_duration_s":0.116127,"scheduling_latency_s":0.116141,"redis_calls":10,"redis_duration_s":0.002177,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001077,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000684,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000416,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021357,"completed_at":"2026-11-07T12:13:05.183Z","load_balancing_strategy":"primary","db_duration_s":0.005394,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2146gitlab # [ 250.867841] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.185Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"667905c117cd60551db51d6c","created_at":"2026-11-07T12:13:05.046Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.047Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-667905c117cd60551db51d6c: start","job_status":"start","queue_duration_s":0.137336,"scheduling_latency_s":0.137351}2147gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses, in 0.16 seconds)2148gitlab # [ 250.868403] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.203Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"667905c117cd60551db51d6c","created_at":"2026-11-07T12:13:05.046Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.047Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-667905c117cd60551db51d6c: done: 0.017943 sec","job_status":"done","queue_duration_s":0.137336,"scheduling_latency_s":0.137351,"redis_calls":7,"redis_duration_s":0.00157,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001142,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000428,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017943,"completed_at":"2026-11-07T12:13:05.203Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00436,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2149gitlab # [ 250.909987] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.204Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9bc4b28856a154ae4225d2d9","created_at":"2026-11-07T12:13:05.048Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.049Z","job_size_bytes":19,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9bc4b28856a154ae4225d2d9: start","job_status":"start","queue_duration_s":0.154902,"scheduling_latency_s":0.154916}2150gitlab # [ 250.952680] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.221Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9bc4b28856a154ae4225d2d9","created_at":"2026-11-07T12:13:05.048Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.049Z","job_size_bytes":19,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9bc4b28856a154ae4225d2d9: done: 0.016971 sec","job_status":"done","queue_duration_s":0.154902,"scheduling_latency_s":0.154916,"redis_calls":8,"redis_duration_s":0.0016589999999999999,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001261,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000398,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016971,"completed_at":"2026-11-07T12:13:05.221Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004313,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2151gitlab # [ 250.955478] gitaly[909]: time="2026-11-07T12:13:05.385Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYTEBYJENMB1QQ2MK331CV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:35.384" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:13:05.385" grpc.time_ms=0.432 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2152gitlab # [ 250.996982] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:13:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses HTTP/1.1" 200 1313 "" "curl/8.21.0" 1292153gitlab # [ 250.997733] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.222Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7c29774aa7d50d4e65c14ee6","created_at":"2026-11-07T12:13:05.049Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.050Z","job_size_bytes":66,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7c29774aa7d50d4e65c14ee6: start","job_status":"start","queue_duration_s":0.171405,"scheduling_latency_s":0.171419}2154gitlab # [ 250.998517] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.237Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7c29774aa7d50d4e65c14ee6","created_at":"2026-11-07T12:13:05.049Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.050Z","job_size_bytes":66,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7c29774aa7d50d4e65c14ee6: done: 0.01485 sec","job_status":"done","queue_duration_s":0.171405,"scheduling_latency_s":0.171419,"redis_calls":7,"redis_duration_s":0.0014860000000000001,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001079,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000407,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01485,"completed_at":"2026-11-07T12:13:05.237Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002803,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2155gitlab # [ 251.040053] gitaly[909]: time="2026-11-07T12:13:05.434Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYTDPQD87TMFFG1TZQGBTY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-11-07T12:13:35.433" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:13:05.433" grpc.time_ms=1.018 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2156gitlab # [ 251.040759] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.238Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"b07234bb931a50b2db274fc8","created_at":"2026-11-07T12:13:05.051Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.052Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b07234bb931a50b2db274fc8: start","job_status":"start","queue_duration_s":0.186128,"scheduling_latency_s":0.186142}2157gitlab # [ 251.048233] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.261Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"b07234bb931a50b2db274fc8","created_at":"2026-11-07T12:13:05.051Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.052Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b07234bb931a50b2db274fc8: done: 0.02286 sec","job_status":"done","queue_duration_s":0.186128,"scheduling_latency_s":0.186142,"redis_calls":7,"redis_duration_s":0.001575,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001136,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02286,"completed_at":"2026-11-07T12:13:05.261Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005258,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2158gitlab # [ 251.104134] gitaly[909]: time="2026-11-07T12:13:05.459Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYTDPQD87TMFFG1TZQGBTY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:35.457" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:13:05.458" grpc.time_ms=0.61 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2159gitlab # [ 251.104779] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.262Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"ae51c45cf010301a113aa119","created_at":"2026-11-07T12:13:05.054Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.055Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-ae51c45cf010301a113aa119: start","job_status":"start","queue_duration_s":0.206689,"scheduling_latency_s":0.206703}2160gitlab # [ 251.111623] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.284Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"ae51c45cf010301a113aa119","created_at":"2026-11-07T12:13:05.054Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.055Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-ae51c45cf010301a113aa119: done: 0.022558 sec","job_status":"done","queue_duration_s":0.206689,"scheduling_latency_s":0.206703,"redis_calls":7,"redis_duration_s":0.0013510000000000002,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000339,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022558,"completed_at":"2026-11-07T12:13:05.284Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008998,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2161gitlab # [ 251.161127] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.335Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"cab310f8c6b102658a963977","created_at":"2026-11-07T12:13:05.056Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.056Z","job_size_bytes":6,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-cab310f8c6b102658a963977: start","job_status":"start","queue_duration_s":0.279002,"scheduling_latency_s":0.279027}2162gitlab # [ 251.163368] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.348Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"cab310f8c6b102658a963977","created_at":"2026-11-07T12:13:05.056Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.056Z","job_size_bytes":6,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-cab310f8c6b102658a963977: done: 0.012588 sec","job_status":"done","queue_duration_s":0.279002,"scheduling_latency_s":0.279027,"redis_calls":7,"redis_duration_s":0.002211,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001852,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000359,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006725,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012588,"completed_at":"2026-11-07T12:13:05.348Z","load_balancing_strategy":"primary","db_duration_s":0.000722,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2163gitlab # [ 251.217768] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.349Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"380cd7d160b4c33f0b75e540","created_at":"2026-11-07T12:13:05.057Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.058Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-380cd7d160b4c33f0b75e540: start","job_status":"start","queue_duration_s":0.291601,"scheduling_latency_s":0.291615}2164gitlab # [ 251.218596] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.373Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"380cd7d160b4c33f0b75e540","created_at":"2026-11-07T12:13:05.057Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.058Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-380cd7d160b4c33f0b75e540: done: 0.023561 sec","job_status":"done","queue_duration_s":0.291601,"scheduling_latency_s":0.291615,"redis_calls":7,"redis_duration_s":0.004276,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003896,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00038,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023561,"completed_at":"2026-11-07T12:13:05.373Z","load_balancing_strategy":"primary","db_duration_s":0.005543,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2165gitlab # [ 251.260130] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.374Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"2f164c458cdacbf5529cb4c3","created_at":"2026-11-07T12:13:05.096Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.097Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2f164c458cdacbf5529cb4c3: start","job_status":"start","queue_duration_s":0.276695,"scheduling_latency_s":0.276709}2166gitlab # [ 251.265587] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.468Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"2f164c458cdacbf5529cb4c3","created_at":"2026-11-07T12:13:05.096Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-7693317d067e4ded","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.097Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2f164c458cdacbf5529cb4c3: done: 0.093923 sec","job_status":"done","queue_duration_s":0.276695,"scheduling_latency_s":0.276709,"gitaly_calls":2,"gitaly_duration_s":0.00507,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.0068070000000000006,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001046,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00082,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000268,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001496,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000261,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000409,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001461,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053269,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.069534815,"duration_s":0.093923,"completed_at":"2026-11-07T12:13:05.468Z","load_balancing_strategy":"primary","db_duration_s":0.032017,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2167gitlab # [ 251.313703] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.469Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"16b3a3f7c2996e24a212ba1e","created_at":"2026-11-07T12:13:05.421Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-4897d615f8d74f04","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.423Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-16b3a3f7c2996e24a212ba1e: start","job_status":"start","queue_duration_s":0.046173,"scheduling_latency_s":0.046187}2168gitlab # [ 251.353865] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.545Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"16b3a3f7c2996e24a212ba1e","created_at":"2026-11-07T12:13:05.421Z","trace_propagation_headers":{"sentry-trace":"f66afc8b9d5348568bbb759e3f5f155c-4897d615f8d74f04","baggage":"sentry-trace_id=f66afc8b9d5348568bbb759e3f5f155c,sentry-release=Unknown"},"correlation_id":"01M6TYTDPQD87TMFFG1TZQGBTY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.423Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-16b3a3f7c2996e24a212ba1e: done: 0.076427 sec","job_status":"done","queue_duration_s":0.046173,"scheduling_latency_s":0.046187,"redis_calls":7,"redis_duration_s":0.001257,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000359,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.076427,"completed_at":"2026-11-07T12:13:05.545Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003851,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2169gitlab # [ 251.440255] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:05.933Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5ab5fa787ba1de2d1503a3c0","created_at":"2026-11-07T12:13:05.926Z","trace_propagation_headers":{"sentry-trace":"96e11829473340bb8e262ce772407be7-fcf7d09ce1274db9","baggage":"sentry-trace_id=96e11829473340bb8e262ce772407be7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYTE1J588QWAR5YKJPZYWR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.931Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5ab5fa787ba1de2d1503a3c0: start","job_status":"start","queue_duration_s":0.002119,"scheduling_latency_s":0.002178}2170gitlab # [ 251.460224] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:13:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 10062171gitlab # [ 251.556979] gitaly[909]: time="2026-11-07T12:13:06.050Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYTE1J588QWAR5YKJPZYWR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:13:06.049" grpc.time_ms=0.759 pid=909 span.kind=server system=grpc2172gitlab # [ 251.605643] gitaly[909]: time="2026-11-07T12:13:06.099Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYTE1J588QWAR5YKJPZYWR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:13:06.098" grpc.time_ms=0.296 pid=909 span.kind=server system=grpc2173gitlab # [ 251.642967] gitaly[909]: time="2026-11-07T12:13:06.136Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M6TYTE1J588QWAR5YKJPZYWR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-11-07T12:13:06.136" grpc.time_ms=0.301 pid=909 span.kind=server system=grpc2174gitlab # [ 251.663116] nixbot[2628]: {"ts": "2026-11-07T12:13:06.156Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 2, "sha": "e3f8e82aecb9f4e4ea270ab48ee1a63907feb686", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []}2175gitlab # [ 251.668431] gitaly[909]: time="2026-11-07T12:13:06.161Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M6TYTE1J588QWAR5YKJPZYWR diskcache=7e677511-3523-443d-8d3a-f86240d008ba grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-11-07T12:13:36.025" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:13:06.026" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2176gitlab # [ 251.677872] gitaly[909]: time="2026-11-07T12:13:06.162Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=75 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7000 command.oublock=0 command.real_time_ms=126 command.spawn_token_fork_ms=1 command.system_time_ms=49 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYTE1J588QWAR5YKJPZYWR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-11-07T12:13:36.025" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-11-07T12:13:06.026" grpc.time_ms=135.485 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 251.710306] gitaly[909]: time="2026-11-07T12:13:06.203Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M6TYTE1J588QWAR5YKJPZYWR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-11-07T12:13:36.202" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:13:06.203" grpc.time_ms=0.556 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2178gitlab # [ 251.734327] gitaly[909]: time="2026-11-07T12:13:06.227Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M6TYTE1J588QWAR5YKJPZYWR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-11-07T12:13:36.226" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-11-07T12:13:06.227" grpc.time_ms=0.549 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2179gitlab # [ 251.746501] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:06.239Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5ab5fa787ba1de2d1503a3c0","created_at":"2026-11-07T12:13:05.926Z","trace_propagation_headers":{"sentry-trace":"96e11829473340bb8e262ce772407be7-fcf7d09ce1274db9","baggage":"sentry-trace_id=96e11829473340bb8e262ce772407be7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M6TYTE1J588QWAR5YKJPZYWR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:05.931Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5ab5fa787ba1de2d1503a3c0: done: 0.306675 sec","job_status":"done","queue_duration_s":0.002119,"scheduling_latency_s":0.002178,"gitaly_calls":3,"gitaly_duration_s":0.144557,"redis_calls":73,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011988,"redis_read_bytes":154,"redis_write_bytes":20037,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001067,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001068,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":23,"redis_queues_duration_s":0.00246,"redis_queues_read_bytes":25,"redis_queues_write_bytes":13382,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.004012,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3094,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000355,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000384,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001575,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.01,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.013,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.118939,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.262428884,"duration_s":0.306675,"completed_at":"2026-11-07T12:13:06.239Z","load_balancing_strategy":"primary","db_duration_s":0.032791,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2180gitlab # [ 251.787123] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:06.241Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"26a77a5d732078b3f939e679","created_at":"2026-11-07T12:13:06.020Z","trace_propagation_headers":{"sentry-trace":"96e11829473340bb8e262ce772407be7-bb92985d83924a26","baggage":"sentry-trace_id=96e11829473340bb8e262ce772407be7,sentry-release=Unknown"},"correlation_id":"01M6TYTE1J588QWAR5YKJPZYWR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:06.021Z","job_size_bytes":23,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-26a77a5d732078b3f939e679: start","job_status":"start","queue_duration_s":0.219425,"scheduling_latency_s":0.219441}2181gitlab # [ 251.787753] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/11/07:12:13:06 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 642182gitlab # [ 251.788275] gitaly[909]: time="2026-11-07T12:13:06.260Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=20 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M6TYTF8MF5Y83K2D10W48HS0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-11-07T12:13:06.235" grpc.time_ms=25.031 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc2183gitlab # [ 251.792195] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:06.285Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"26a77a5d732078b3f939e679","created_at":"2026-11-07T12:13:06.020Z","trace_propagation_headers":{"sentry-trace":"96e11829473340bb8e262ce772407be7-bb92985d83924a26","baggage":"sentry-trace_id=96e11829473340bb8e262ce772407be7,sentry-release=Unknown"},"correlation_id":"01M6TYTE1J588QWAR5YKJPZYWR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:06.021Z","job_size_bytes":23,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-26a77a5d732078b3f939e679: done: 0.04422 sec","job_status":"done","queue_duration_s":0.219425,"scheduling_latency_s":0.219441,"redis_calls":7,"redis_duration_s":0.001079,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000793,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04422,"completed_at":"2026-11-07T12:13:06.285Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004779,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2184gitlab # [ 251.838623] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:06.286Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a6073467126aa487e9f9a0bb","created_at":"2026-11-07T12:13:06.166Z","trace_propagation_headers":{"sentry-trace":"96e11829473340bb8e262ce772407be7-bb92985d83924a26","baggage":"sentry-trace_id=96e11829473340bb8e262ce772407be7,sentry-release=Unknown"},"correlation_id":"01M6TYTE1J588QWAR5YKJPZYWR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:06.169Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a6073467126aa487e9f9a0bb: start","job_status":"start","queue_duration_s":0.117432,"scheduling_latency_s":0.117448}2185gitlab # [ 251.839388] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:06.303Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a6073467126aa487e9f9a0bb","created_at":"2026-11-07T12:13:06.166Z","trace_propagation_headers":{"sentry-trace":"96e11829473340bb8e262ce772407be7-bb92985d83924a26","baggage":"sentry-trace_id=96e11829473340bb8e262ce772407be7,sentry-release=Unknown"},"correlation_id":"01M6TYTE1J588QWAR5YKJPZYWR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:06.169Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a6073467126aa487e9f9a0bb: done: 0.016656 sec","job_status":"done","queue_duration_s":0.117432,"scheduling_latency_s":0.117448,"redis_calls":7,"redis_duration_s":0.000897,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016656,"completed_at":"2026-11-07T12:13:06.303Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2186gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses2187gitlab # [ 251.892141] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:06.303Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e004269362809cbc54652095","created_at":"2026-11-07T12:13:06.174Z","trace_propagation_headers":{"sentry-trace":"96e11829473340bb8e262ce772407be7-bb92985d83924a26","baggage":"sentry-trace_id=96e11829473340bb8e262ce772407be7,sentry-release=Unknown"},"correlation_id":"01M6TYTE1J588QWAR5YKJPZYWR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:06.176Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e004269362809cbc54652095: start","job_status":"start","queue_duration_s":0.127631,"scheduling_latency_s":0.127646}2188gitlab # [ 251.892409] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:06.320Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e004269362809cbc54652095","created_at":"2026-11-07T12:13:06.174Z","trace_propagation_headers":{"sentry-trace":"96e11829473340bb8e262ce772407be7-bb92985d83924a26","baggage":"sentry-trace_id=96e11829473340bb8e262ce772407be7,sentry-release=Unknown"},"correlation_id":"01M6TYTE1J588QWAR5YKJPZYWR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:06.176Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e004269362809cbc54652095: done: 0.016623 sec","job_status":"done","queue_duration_s":0.127631,"scheduling_latency_s":0.127646,"redis_calls":7,"redis_duration_s":0.0008519999999999999,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000618,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016623,"completed_at":"2026-11-07T12:13:06.320Z","load_balancing_strategy":"primary","db_duration_s":0.002682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2189gitlab # [ 251.922572] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:06.321Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"ab2a561d02370bdedcc8e9e1","created_at":"2026-11-07T12:13:06.181Z","trace_propagation_headers":{"sentry-trace":"96e11829473340bb8e262ce772407be7-bb92985d83924a26","baggage":"sentry-trace_id=96e11829473340bb8e262ce772407be7,sentry-release=Unknown"},"correlation_id":"01M6TYTE1J588QWAR5YKJPZYWR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:06.182Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-ab2a561d02370bdedcc8e9e1: start","job_status":"start","queue_duration_s":0.138699,"scheduling_latency_s":0.138712}2190gitlab # [ 251.962433] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:06.339Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"ab2a561d02370bdedcc8e9e1","created_at":"2026-11-07T12:13:06.181Z","trace_propagation_headers":{"sentry-trace":"96e11829473340bb8e262ce772407be7-bb92985d83924a26","baggage":"sentry-trace_id=96e11829473340bb8e262ce772407be7,sentry-release=Unknown"},"correlation_id":"01M6TYTE1J588QWAR5YKJPZYWR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:06.182Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-ab2a561d02370bdedcc8e9e1: done: 0.01811 sec","job_status":"done","queue_duration_s":0.138699,"scheduling_latency_s":0.138712,"redis_calls":10,"redis_duration_s":0.00123,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000637,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000361,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01811,"completed_at":"2026-11-07T12:13:06.339Z","load_balancing_strategy":"primary","db_duration_s":0.002653,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2191gitlab # [ 251.973820] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:06.340Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"275998007d72e8daffedb61f","created_at":"2026-11-07T12:13:06.182Z","trace_propagation_headers":{"sentry-trace":"96e11829473340bb8e262ce772407be7-bb92985d83924a26","baggage":"sentry-trace_id=96e11829473340bb8e262ce772407be7,sentry-release=Unknown"},"correlation_id":"01M6TYTE1J588QWAR5YKJPZYWR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:06.183Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-275998007d72e8daffedb61f: start","job_status":"start","queue_duration_s":0.156584,"scheduling_latency_s":0.156596}2192gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e3f8e82aecb9f4e4ea270ab48ee1a63907feb686/statuses, in 0.11 seconds)2193(finished: subtest: eval and build post commit statuses, in 7.00 seconds)2194(finished: run the VM test script, in 307.55 seconds)2195test script finished in 307.57s2196cleanup2197kill QemuMachine (pid 46)2198gitlab # [ 252.022245] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-11-07T12:13:06.355Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"275998007d72e8daffedb61f","created_at":"2026-11-07T12:13:06.182Z","trace_propagation_headers":{"sentry-trace":"96e11829473340bb8e262ce772407be7-bb92985d83924a26","baggage":"sentry-trace_id=96e11829473340bb8e262ce772407be7,sentry-release=Unknown"},"correlation_id":"01M6TYTE1J588QWAR5YKJPZYWR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-11-07T12:13:06.183Z","job_size_bytes":3,"pid":2500,"sidekiq_tid":"m7ww","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-275998007d72e8daffedb61f: done: 0.01499 sec","job_status":"done","queue_duration_s":0.156584,"scheduling_latency_s":0.156596,"redis_calls":7,"redis_duration_s":0.000869,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000227,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"dqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2199gitlab # b2200(finished: cleanup, in 1.46 seconds)2201additionally exposed symbols:2202 gitlab,2203 vlan1,2204 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2205[]2206[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-11-07T12:12:11.170Z', 'push_events': True, 'tag_push_events': True, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2207[]2208[]2209[]2210[]2211[]2212[]2213[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'e3f8e82aecb9f4e4ea270ab48ee1a63907feb686', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-11-07T12:12:58.255366Z', 'started_at': '2026-11-07T12:12:58.645771Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2214[{'id': 5, 'sha': 'e3f8e82aecb9f4e4ea270ab48ee1a63907feb686', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-11-07T12:12:58.612Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2215[{'id': 5, 'sha': 'e3f8e82aecb9f4e4ea270ab48ee1a63907feb686', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-11-07T12:12:58.612Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2216[{'id': 5, 'sha': 'e3f8e82aecb9f4e4ea270ab48ee1a63907feb686', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-11-07T12:12:58.612Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2217[{'id': 5, 'sha': 'e3f8e82aecb9f4e4ea270ab48ee1a63907feb686', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-11-07T12:12:58.612Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2218[{'id': 5, 'sha': 'e3f8e82aecb9f4e4ea270ab48ee1a63907feb686', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-11-07T12:12:58.612Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2219[{'id': 5, 'sha': 'e3f8e82aecb9f4e4ea270ab48ee1a63907feb686', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 5s (1 warning)', 'created_at': '2026-11-07T12:12:58.612Z', 'started_at': None, 'finished_at': '2026-11-07T12:13:04.757Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'e3f8e82aecb9f4e4ea270ab48ee1a63907feb686', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-11-07T12:13:04.912Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2220[{'id': 5, 'sha': 'e3f8e82aecb9f4e4ea270ab48ee1a63907feb686', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 5s (1 warning)', 'created_at': '2026-11-07T12:12:58.612Z', 'started_at': None, 'finished_at': '2026-11-07T12:13:04.757Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'e3f8e82aecb9f4e4ea270ab48ee1a63907feb686', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-11-07T12:13:04.912Z', 'started_at': None, 'finished_at': '2026-11-07T12:13:05.916Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]